Jetson Xavier NX + multi-stream + multi-model inference + python + Azure IoT + Runtime

Hello,

I need to develop a multi-stream & multi-model inference PoC using python on any of the Jetson Device, so after my research is found that Jetson NX is a suitable device.

Now my concern here is, Can we have a python application with multiple stream as input and multiple different Computer Vision based use cases to infer and send the metadata to lets say Azure IoTHub using the Azure Runtime in real-time.

Can someone please confirm that this is possible and help me with some references.

Thanks.

Hi,

You can check if our Deepstream SDK can meet your requirement:

https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_Overview.html#deepstream-graph-architecture

Thanks.

Hi AsthaLLL,

Thanks for the reply, I looked into the link that you shared that was helpful.

Now we are planning to use this PE1000N|AIoT & Industrial Solutions|ASUS Global hardware, with the Jetson Xavier NX 16GB configuration.

Will this hardware be able to handle multi-stream and multi-model scenario?

Kindly, let me know your thoughts.

Thanks.

Hi,

Since the emmc only has 16GB, please check with the vendor to see if they can support Deepstream.
Thanks.

Hi AastaLLL,

Can you recommend any product from other vendor which can supports Deepstream.

Thanks

Hi,

Please check below for the Jetson series:

For the device from the vendor, since there are lots of variants, it’s recommended to check with the vendor directly.

Thanks.

Hi AastaLLL,

Thanks for sharing the list of Nvidia Embedded Systems lists, we had already gone through it earlier. We are looking to finalize a finished Jetson Xavier Nx board that can handle our use case.

It would be really helpful to us if you can list down the top 3 vendors so that we can directly communicate with them.

Thanks

Hi,

Sorry for the late update.
Will find someone to help you with this issue.

Thanks.

Please find those products from our ecosystem partmers at Jetson Partner Hardware Products | NVIDIA Developer