NVIDIA NIM - TensorRT TurboXL

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
,
1

It is possible to run this on the AGX Orin:
https://docs.nvidia.com/ai-enterprise/nim-generative-ai/latest/sdxl-turbo.html

The instructions seem to indicate no but I wanted to confirm.

Thanks in advance!

3

Hi,

You can find the NIM support matrix below. Currently, it is only for the desktop GPU.

https://docs.nvidia.com/nim/large-language-models/latest/support-matrix.html

But we have some generative AI for Jetson, please check if the below can meet your requirements:

https://www.jetson-ai-lab.com/tutorial_stable-diffusion.html

Thanks.