Jetson AI Lab - ML DevOps, Containers, Core Inferencing

Autonomous Machines Jetson & Embedded Systems Jetson Projects
,
15

4/8/2024 - New Container Images and Tool Usage

This past week these containers and images have been added, thanks everyone!

  • ollama
    • dustynv/ollama:r35.4.1
      dustynv/ollama:r36.2.0
  • piper-tts
    • dustynv/piper-tts:r35.4.1
      dustynv/piper-tts:r36.2.0
  • homeassistant-core
    • dustynv/homeassistant-core:r35.4.1
    • dustynv/homeassistant-core:r36.2.0

There is now an install script and jetson-containers launcher with improved syntactic sugar:

# install python requirements and link autotag and launcher under /usr/local/bin
git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh

# run or build containers from any directory
jetson-containers run $(autotag ollama)
jetson-containers build --name=my_container l4t-text-generation

Also, documentation has been added for changing the CUDA version, along with other package versions and the role of the pip cache in accelerating builds.