tensorrt推理Qwen/Qwen3-VL-8B-Instruct不兼容

Robotics & Edge Computing Jetson Systems Jetson Thor
,
1

请教一下，Jetson Agx Thor边缘设备，在用tensorrt推理Qwen/Qwen3-VL-8B-Instruct说不兼容。请问是怎么解决呢、谢谢

3

Hi,

Do you mean TensorRT-LLM?
If yes, TensorRT-LLM doesn’t support Thor. Please use vLLM instead.

Thanks.

4

是TensorRT推理，不是TensorRT-LLM。vllm也没有兼容

5

Hi,

You will need to use TensorRT-LLM for an LLM model.
But TensorRT-LLM is not available on the Jetson platform.

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.