Running Phi-3.5-vision on the Nvidia Jetson Orin platform

Robotics & Edge Computing Jetson & Embedded Systems Jetson Projects
1

Hello, NVIDIA Jetson AI enthusiasts and developers!

Here is my post on running Microsoft Phi-3.5-Vision on the NVIDIA Jetson AGX Orin 64GB Developer Kit using ONNX Runtime GenAI and TensorRT-LLM. Both methods demonstrated decent inference speeds, highlighting the efficiency of running Phi-3.5-Vision on the NVIDIA Jetson AGX Orin.

2 Likes