Multi processing on embedded card (Jetson TX2, Xavier, ...)

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
,
1

I want to analyze an image by several neural networks in an embedded system. My question is the following :
can we run in parallel, on graphic cards like Jetson TX2 or Xavier, several inference tasks. Each task using a different neural network. For example : A task using a YOLOv5 and an other task using a Mask RCNN.

Thanking you in advance for your response

Best regards
Alain

2

The answer is yes, but there will be some possible performance impact.
In your case since your target platform is Jetson, I am moving this discussion to an area where there are a number of community members which would have similar requirements to you.

3

Suggest to use DeepStream SDK, please find more information from NVIDIA DeepStream SDK | NVIDIA Developer

4

Thank you for this answer.

One last question: If you use different networks, do you have to load and unload them from the memory before and after each use ?

Best regards
Alain

7

Hi,
Yes, DeepStream SDK is based on gstreamer and in each run, it loads and unloads the model.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.