Hi Team
We are using Jetson Orin Nano 8gb with the latest jetpack version of 6.0 and we are trying to run the NanoVLM model for that we are following the below steps:
Cloned git from the following repository: git clone GitHub - dusty-nv/jetson-containers: Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
Install the jetson-containers utilities: bash jetson-containers/install.sh
Add your user to the docker group : sudo usermod -aG docker $USER.
Container images are compatible with other minor versions of JetPack/L4T:
L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)
Downloaded the docker image by using the following command: jetson-containers run $(autotag nano_llm).
Finally used this below command to run the model with sample offline videos:jetson-containers run $(autotag nano_llm) \ python3 -m nano_llm.vision.video --model Efficient-Large-Model/VILA1.5-3b --max-images 8 --max-new-tokens 48 --video-input /data/my_video.mp4 --video-output /data/my_output.mp4 --prompt 'What changes occurred in the video?’
Reference Link: NanoVLM - NVIDIA Jetson AI Lab
It is working with offline video/image. while testing with live streaming used below command:
jetson-containers run $(autotag nano_llm)
python3 -m nano_llm.agents.video_query --api=mlc
–model Efficient-Large-Model/VILA1.5-3b
–max-context-len 256
–max-new-tokens 32
–video-input /dev/video0
–video-output webrtc://@:8554/output
The model successfully loads and generates the expected output prompts. However, when accessing the live video stream via https://localhost:8050, no video is visible.
Tried to disable ‘chrome://flags#enable-webrtc-hide-local-ips-with-mdns’ its shows no matching experiments, also tried with Firefox but still live feed from camera not visible in browser.
camera is working tested with the below command:
gst-launch-1.0 v4l2src device=/dev/video0 ! videoconvert ! autovideosink
Can you help us to solve this issue
Regards
Karthika