Vllm package update (v0.11.0) on pypi.jetson-ai-lab.io (JP6)

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Hi everyone,

I have a question about the Jetson AI Lab PyPI repository for JetPack 6, located at:

First, a big thank you to the team or individuals maintaining this repository. It is an incredibly helpful resource for development on the Jetson platform!

I noticed that the vllm project has recently released a new version (v0.11.0). I was wondering what the process or timeline looks like for getting this new version added to the jetson-ai-lab PyPI?

If this isn’t the correct forum for this question, could you please let me know who maintains this repository or where the best place would be to make this request?

Thank you for your time and help!

2

*** Please note that this reply is generated by LLM automatically ***

The question you’ve asked is not directly related to the provided context, but I’ll do my best to provide a helpful answer.

The Jetson AI Lab PyPI repository is a valuable resource for developers working on the Jetson platform. The repository is maintained by NVIDIA, and the team responsible for it is likely composed of NVIDIA engineers and developers.

Regarding the process and timeline for adding new versions to the PyPI repository, it’s difficult to provide an exact answer without more information. However, I can offer some general insights.

Typically, the process of adding a new version to a PyPI repository involves the following steps:

  1. Development and testing: The NVIDIA team develops and tests the new version of the Jetson AI Lab repository.
  2. Release planning: The team plans the release of the new version, including coordinating with other teams and stakeholders.
  3. Package preparation: The team prepares the new version of the package, including updating the documentation, testing, and validation.
  4. PyPI submission: The team submits the new version to PyPI, which involves creating a new release on the PyPI website and uploading the package files.

The timeline for adding a new version to the PyPI repository can vary depending on several factors, such as the complexity of the changes, the availability of resources, and the priority of the release.

In this case, the new version (v0.1.10) has already been released, and it’s likely that the NVIDIA team is working on adding it to the PyPI repository. However, without more information, it’s difficult to provide a specific timeline or estimate for when the new version will be available on PyPI.

If you’re interested in getting the new version added to the PyPI repository, you can try reaching out to the NVIDIA team through the following channels:

  • NVIDIA Developer Forums: You can post a question or request on the NVIDIA Developer Forums, which are monitored by NVIDIA engineers and developers.
  • NVIDIA Support: You can contact NVIDIA Support directly and ask about the status of the new version on PyPI.
  • Jetson AI Lab GitHub Repository: You can also try contacting the maintainers of the Jetson AI Lab GitHub repository, which may provide more information on the release process and timeline.

I hope this helps, and please let me know if you have any further questions!

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

4

This didn’t solve my issue.

6

Hi,

Sorry that we don’t have a timeline for the vLLM v0.11.0.
The server is updated when it is required.

But the packages are built with the jetson-container.
You can find the source below:

Thanks.