No compatible text-generation-webui

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
, ,
1

Hi, I’m trying to build text-generation-webui on orin nano. I’m now at final step to build text-generation-webui:r36.4-cu126-22.04-text-generation-webui. I got this error:

Step 7/9 : RUN /tmp/install-oobabooga.sh
 ---> Running in 648e0b40b4e6
+ git clone https://github.com/oobabooga/text-generation-webui /opt/text-generation-webui
Cloning into '/opt/text-generation-webui'...
+ git -C /opt/text-generation-webui checkout main
Already on 'main'
Your branch is up to date with 'origin/main'.
+ sed -i -e 's|^bitsandbytes.*|#bitsandbytes|g' -e 's|^llama-cpp-python.*|llama-cpp-python|g' -e 's|^exllamav2.*|exllamav2|g' -e 's|^autoawq.*||g' -e 's|^numpy.*|numpy|g
' -e 's|^aqlm.*|aqlm|g' -e 's|^transformers.*|transformers|g' -e 's|^https://github.com/turboderp/exllama.*||g' -e 's|^https://github.com/jllllll/ctransformers-cuBLAS-wh
eels.*|#https://github.com/jllllll/ctransformers-cuBLAS-wheels|g' /opt/text-generation-webui/requirements.txt
sed: can't read /opt/text-generation-webui/requirements.txt: No such file or directory
The command '/bin/sh -c /tmp/install-oobabooga.sh' returned a non-zero code: 2
[23:13:01] Failed building:  text-generation-webui

Traceback (most recent call last):
  File "/home/thalia/LLM/jetson-containers/jetson_containers/build.py", line 129, in <module>
    build_container(**vars(args))
  File "/home/thalia/LLM/jetson-containers/jetson_containers/container.py", line 229, in build_container
    status = subprocess.run(cmd.replace(_NEWLINE_, ' '), executable='/bin/bash', shell=True, check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command 'DOCKER_BUILDKIT=0 docker build --network=host   --tag text-generation-webui:r36.4-cu126-22.04-text-generation-webui   --file /hom
e/thalia/LLM/jetson-containers/packages/llm/text-generation-webui/Dockerfile   --build-arg BASE_IMAGE=text-generation-webui:r36.4-cu126-22.04-auto_awq   --build-arg OOBA
BOOGA_REF="refs/heads/main"   --build-arg OOBABOOGA_SHA="main"    /home/thalia/LLM/jetson-containers/packages/llm/text-generation-webui 2>&1 | tee /home/thalia/LLM/jetso
n-containers/logs/20250531_231219/build/23o23_text-generation-webui_r36.4-cu126-22.04-text-generation-webui.txt; exit ${PIPESTATUS[0]}' returned non-zero exit status 2.

According to config.py, it is using main branch of https://github.com/oobabooga/text-generation-webui, which seems inconsistent with install.sh. I also tried other 2 options from config.py but none of them worked.

package = [
    oobabooga('main', branch='main', default=True),
    oobabooga('1.7', tag='v1.7', build_args=dict(LD_PRELOAD_LIBS='/usr/local/lib/python3.8/dist-packages/sklearn/__check_build/../../scikit_learn.libs/libgomp-d22c30c5.so.1.0.0')),
    oobabooga('6a7cd01', sha='6a7cd01ebf8021a8ee6da094643f09da41516ccd'), # last commit to support original server API
]

Can you advise which tag or branch I should refer? Below is my system information.
L4T_VERSION 36.4.3 │ JETPACK_VERSION 6.2 │
│ CUDA_VERSION 12.6 │ PYTHON_VERSION 3.10 │
│ SYSTEM_ARCH aarch64 │ LSB_RELEASE 22.04

4

Hi,

Please load our latest build text-generation-webui based on JP6.2

jetson-containers run daivdl487/stable-diffusion-webui:r36.4.3

Thanks

5

Thanks I can download the image now.
The default command of this image is /bin/bash\

thalia@thalia-desktop:~/LLM$ docker inspect --format '{{.Config.Cmd}}' daivdl487/stable-diffusion-webui:r36.4.3
[/bin/bash]

Wondering what command I need to run to start web server?

6

Hi,

Please refer to the official doc mentioned steps.

Thanks