Docker jetson-containers [gstreamer] gstEncoder -- codec not specified, defaulting to H.264 failed to find/open file /proc/device-tree/model

[father]

./run.sh -v /ssd/home/nvidia/jetson-containers/packages/llm/local_llm:/opt/local_llm/local_llm -e SSL_KEY=/data/key.pem -e SSL_CERT=/data/cert.pem $(./autotag local_llm:r35.4.1) python3 -m local_llm.agents.video_query --api=mlc --verbose --model liuhaotian/llava-v1.5-13b --max-new-tokens 32 --video-input /dev/video0 --video-output webrtc://@:8554/output --prompt “How many fingers am I holding up?”
jetpack版本5.1.1

[gstreamer] gstEncoder – codec not specified, defaulting to H.264
failed to find/open file /proc/device-tree/model
如何在不更换jetpack版本的情况下成功显示，感谢

[dusty_nv]

Hi @father, can you try setting your chrome://flags#enable-webrtc-hide-local-ips-with-mdns to disabled in your browser? I would also recommend upgrading to JetPack 6, as that as what I have been developing this demo on.

You should also try just basic video streaming in the container first:

./run.sh -v /ssd/home/nvidia/jetson-containers/packages/llm/local_llm:/opt/local_llm/local_llm \
  -e SSL_KEY=/data/key.pem -e SSL_CERT=/data/cert.pem \
  $(./autotag local_llm:r35.4.1) \
     video-viewer.py \
         /dev/video0 \
         webrtc://@:8554/output

Then try this one next:

./run.sh -v /ssd/home/nvidia/jetson-containers/packages/llm/local_llm:/opt/local_llm/local_llm \
  -e SSL_KEY=/data/key.pem -e SSL_CERT=/data/cert.pem \
  $(./autotag local_llm:r35.4.1) \
     python3 -m local_llm.agents.video_stream --debug \
        --video-input /dev/video0 \
        --video-output webrtc://@:8554/output

[father]

非常感谢您的答复您提供的命令均可以打开视频流，难道是模型的问题吗

[father]

感谢我加了debug以后它正常了，能帮我解释一下吗我是个菜鸟，
./run.sh
-e SSL_KEY=/data/key.pem -e SSL_CERT=/data/cert.pem
$(./autotag local_llm)
python3 -m local_llm.agents.video_query --api=mlc --verbose
–model liuhaotian/llava-v1.5-7b
–max-new-tokens 32
–debug
–video-input /dev/video0
–video-output webrtc://@:8554/output
–prompt “How many fingers am I holding up?”

[dusty_nv]

Thanks. After I added debug, it became normal. Can you explain it to me? I’m a newbie.

Hi @father, that’s odd, I’m not sure (especially since --verbose and --debug flag should do the same thing). Debug mode should just have extra logging. I will look into it, for now just run it like that if it’s working for you - thanks for letting me know! 👍

[father]

好的，感谢您得答复如果有结果也麻烦您后期告知我一下，祝您工作顺利，身体健康

[dusty_nv]

Hi @father, with the latest dustynv/local_llm:r36.2.0 container for JetPack 6, I confirmed both normal and debug logging did not result in difference, and also I update the web UI (the port is now 8050)