Is there a suitable jetson-container for Jetpack with L4T R35.6.0? i just want to install vllm on my machine fast

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin NX
1

Continuing the discussion from Getting Error in installing vllm error on Jetson orin nx jetpack6.2:

2

*** Please note that this reply is generated by LLM automatically ***

It seems like you’re experiencing an issue with installing VLLM on your Jetson Orin NX with JetPack 6.2. Unfortunately, the provided context doesn’t contain a specific discussion thread about “Getting Error in installing vllm error on Jetson orin nx jetpack62”. However, I can try to provide some general guidance and potential solutions.

VLLM (Vision Library for Linux Media) is a software library provided by NVIDIA for the Jetson platform, which enables developers to access and process video streams from various sources.

To troubleshoot the issue, you can try the following steps:

  1. Check the installation logs: Look for any error messages or warnings during the installation process. This might give you a hint about what’s going wrong.
  2. Verify the JetPack version: Ensure that you’re running the correct version of JetPack (6.2) on your Jetson Orin NX.
  3. Check the VLLM version: Verify that you’re trying to install the correct version of VLLM compatible with JetPack 6.2.
  4. Dependency issues: Make sure that all dependencies required by VLLM are installed and up-to-date.
  5. Reinstall VLLM: Try reinstalling VLLM using the sudo apt-get install command or through the NVIDIA SDK Manager.

If none of these steps resolve the issue, you may want to provide more details about the error message you’re seeing, such as:

  • The exact error message
  • The installation method you’re using (e.g., SDK Manager, apt-get)
  • Any relevant logs or output

This will help me or other experts provide a more specific solution to your problem.

In comparison to other discussions in the provided context, there are some threads related to installation issues, such as “Assertion issue in UEFI during boot” or “Boot failed”. However, these threads seem to be related to different issues and may not be directly relevant to your VLLM installation problem.

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

4

Thanks， but my need is jetpack with L4T R35.6.0

6

Hi,

For vLLM, we only have the container that was built for r36:

https://hub.docker.com/r/dustynv/vllm/tags

Thanks.