Hi,
Sorry for the missing.
It looks like you are using super mode so the environment should be r36.4.2 or r36.4.3.
As there are some dependencies between the GPU driver and CUDA-related libraries, please use the container built for r36.4.x instead.
dustynv/text-generation-webui:r35.4.1 might have some unexpected issues when running on the r36 environment.
You can build one with jetson-container directly:
$ jetson-containers run $(autotag text-generation-webui)
Namespace(packages=['text-generation-webui'], prefer=['local', 'registry', 'build'], disable=[''], user='dustynv', output='/tmp/autotag', quiet=False, verbose=False)
-- L4T_VERSION=36.4.3 JETPACK_VERSION=6.2 CUDA_VERSION=12.6
-- Finding compatible container image for ['text-generation-webui']
Couldn't find a compatible container for text-generation-webui, would you like to build it? [y/N] y
-- Building containers ['build-essential', 'pip_cache:cu126', 'cuda:12.6', 'cudnn', 'python', 'numpy', 'cmake', 'onnx', 'pytorch:2.5', 'torchvision', 'huggingface_hub', 'rust', 'transformers', 'auto_gptq', 'flash-attention', 'exllama', 'llama_cpp', 'triton', 'auto_awq', 'text-generation-webui']
-- Building container text-generation-webui:r36.4.3-build-essential
...
Thanks.