Jetson Orin TensorRT-Edge-LLM not support QWen3.5-2B

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
,
1

I download the QWen3.5-2B modal, and try to use TensorRT Edge LLM, but it’s failed. It maybe support QWen3 but not QWen3.5. So when the QWen3.5 will be supported?

2

*** Please note that this reply is generated by LLM automatically ***

Based on the provided context, I couldn’t find any information about QWen352B, QWen3, or QWen35. It seems that these are not official NVIDIA Jetson modules or software versions.

However, I can provide some general information about TensorRT Edge and its compatibility with Jetson modules.

TensorRT Edge is a software development kit (SDK) that allows developers to optimize and deploy deep learning models on NVIDIA Jetson modules. The SDK supports various Jetson modules, including the Jetson AGX Orin series.

To determine the compatibility of TensorRT Edge with your specific Jetson module, I recommend checking the official NVIDIA documentation and release notes for TensorRT Edge. You can also check the NVIDIA Jetson Linux API Reference and the TensorRT Support Matrix to see if your module is supported.

If you’re experiencing issues with TensorRT Edge on your Jetson AGX Orin module, I suggest checking the following:

  1. Ensure that you’re using the latest version of TensorRT Edge and the Jetson Linux API.
  2. Verify that your Jetson module is compatible with TensorRT Edge.
  3. Check the release notes and documentation for any known issues or limitations.
  4. Reach out to NVIDIA support or the developer community for further assistance.

Regarding the support for QWen35, I couldn’t find any information about this specific version. If you’re referring to a future version of TensorRT Edge or a specific software release, I recommend checking the official NVIDIA documentation and release notes for updates on compatibility and support.

In summary, without more information about QWen352B, QWen3, and QWen35, I couldn’t provide a specific answer to your question. However, I recommend checking the official NVIDIA documentation and release notes for TensorRT Edge and the Jetson Linux API to determine compatibility and support for your specific Jetson module.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

5

Hi,

TensorRT Edge LLM requires Thor with JetPack 7.1:

It is not available for the Orin series.

Thanks.