LLM based Multimodal AI w/ Azure Open AI & NVIDIA Jetson

This project extends Microsoft/Jarvis allowing you to prompt an Azure hosted LLM instance of ChatGPT to control a variety of GPU accelerated AI inference tasks on an NVIDIA Jetson embedded device. These include capabilities like: ability to generate completely new images based on the pose structure of a base image, produce video and audio from text descriptions, and allow us to answer questions like “Count the number of zebras in this image”. Full steps to reproduce this project can be found in this article at Hackster.io.