I am doing the camera project which is collecting the many IP cameras and inference in real-time. At first, I increased the performance by using thread but I thought using multiprocess is better. But I don’t know how to run CUDA in each process. Thanks
Spec
1x GPU RTX 3090
CPU intel 36 cores
RAM 24 GB