Jetson Orin Nano restarts while running building text-generation-webui (Loading exllamav2_ext extension (JIT)...)

[AastaLLL]

Hi,

Do you flash and install all the components from the JetPack 6.2?
Or you have upgraded from other version like JetPack 6.1?

We have confirmed that the text-generation-webui container can work on a flash JetPack 6.2 environment.
Please check the below link to see if the info helps:

Couldn't find a compatible container for text-generation-webui

Hi, We test the container with the latest JetPack 6.2 and it can work as expected. Please try if the below command can also work on your side: $ jetson-containers build text-generation-webui ... -- Done building container text-generation-webui:r36.4.3 $ sudo docker run -it --rm --runtime=nvidia --network=host --volume /home/nvidia/jetson-containers/packages/llm/auto_awq:/test --volume /home/nvidia/jetson-containers/data:/data --workdir /test text-generation-webui:r36.4.3 /usr/local/lib/python…

Thanks.