You may find this interesting: Adding extensions to text-generation-webui (as packaged by @dusty_nv in jetson-containers)
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui | 86 | 26218 | May 10, 2024 | |
| Jetson Container text-generation-webui not loading models | 4 | 647 | June 5, 2024 | |
| Couldn't find a compatible container for text-generation-webui | 11 | 482 | January 23, 2025 | |
| Problems with "Tutorial - text-generation-webui" | 6 | 749 | February 24, 2025 | |
| Jetson Generative AI Playground - Tutorial 1 - Text Generation | 5 | 1048 | September 27, 2023 | |
| Can't loading "TheBloke_llava-v1.5-13B-GPTQ" with AGXorin 32GB | 9 | 293 | September 10, 2024 | |
| Flash Attention/Torch SDPA on Orin Nano Devleoper kit | 2 | 295 | February 12, 2025 | |
| Text-generation-webui no webpage | 13 | 270 | November 7, 2025 | |
| Announcing new VLLM container & 3.5X increase in Gen AI Performance in just 5 weeks of Jetson AGX Thor Launch | 46 | 3503 | December 14, 2025 | |
| Triton Inference Server + vLLM Backend on the NVIDIA Jetson AGX Orin 64GB Developer Kit | 9 | 1160 | June 16, 2025 |