We are thrilled to announce that we launched “Jetson Generative AI Playground”, a tutorial documentation site for demonstrating how to run popular open-source LLMs and txt2img models using open-source tools on your Jetson!
Jetson is a great platform to run large generative AI models and lets you explore the exciting possibility of generative AI at the edge.
By following the tutorials on the site, you can quickly set up your Jetson with a pre-built container to run popular open-source web UI tools for LLMs (
text-generation-webui) and for image diffusion models (
The site also has pointers to advanced-level tutorials to show techniques to utilize large foundation models on Jetson through knowledge distillation.
When you come up with your Jetson-based project that utilizes an LLM, a txt2img model, or any generative AI models, be sure to share on our Jetson Projects board of our Jetson Forum here.