Hi,
We test the container with the latest JetPack 6.2 and it can work as expected.
Please try if the below command can also work on your side:
$ jetson-containers build text-generation-webui
...
-- Done building container text-generation-webui:r36.4.3
$ sudo docker run -it --rm --runtime=nvidia --network=host --volume /home/nvidia/jetson-containers/packages/llm/auto_awq:/test --volume /home/nvidia/jetson-containers/data:/data --workdir /test text-generation-webui:r36.4.3
/usr/local/lib/python3.10/dist-packages/transformers/utils/hub.py:128: FutureWarning: Using `TRANSFORMERS_CACHE` is deprecated and will be removed in v5 of Transformers. Use `HF_HOME` instead.
warnings.warn(
08:01:21-253741 INFO Starting Text generation web UI
08:01:21-259695 WARNING The --triton flag has been deprecated and will be removed soon. Please remove that flag.
08:01:21-261235 WARNING
You are potentially exposing the web UI to the entire internet without any access password.
You can create one with the "--gradio-auth" flag like this:
--gradio-auth username:password
Make sure to replace username:password with your own.
08:01:21-263644 INFO Loading settings from "settings.yaml"
Running on local URL: http://0.0.0.0:7860
The open the http://[IP]:7860 with a browser can see:
Thanks.