hello and greetings, Right now I am working on yolov8 project for object detection, during inference I realize that instead of using GPU it was using the CPU instead, therefore the slow inference speed which is around ~300ms setup : Hardware: NVIDIA Orin Nano 8GB Object Detection Model: YOLOv8 J…

Hi, Is the libcudart.so.10.2 error fixed? The “bad install directory” should be related to the way you install the package. Thanks.

when i check my pytorch version using torch.version, it came out with ">> torch>version’2.0.0+nv23.05’ " and when im checking my torchvision using import torchvision, it shows error “/home/bizbot/ultralytics/venv/lib/python3.8/site-packages/torchvision/io/images.py:13: Userwarning: Failed to load im…

it still runs on CPU, I reinstall pytorch v2.0.0 and torchvision v0.15.1 and the error still persist during torchvision installation, the bad install directory error, is there any specific installation method to specific path or something?

yes , I reinstall it back again but outside of the virtual environment and it seems it fixed it

Slow YOLOv8 inference speed in Jetson Orin Nano (had trouble with pytorch and torchvision installation)

Robotics & Edge Computing Jetson Systems Jetson Orin Nano

AastaLLL September 18, 2023, 9:02am 4

Hi,

The tutorial is for JetPack 4 which uses CUDA 10.2.
But Orin Nano use JetPack 5 and CUDA 11.4.

Would you mind trying the below container (l4t-pytorch:r35.2.1-pth2.0-py3) to see if it can work on GPU?

Thanks.

Topic		Replies	Views
PyTorch installation issue for jetson orin nano (torch 2.0.0+nv23.05 and torchvision 0.15.1) Jetson Orin Nano pytorch	4	975	October 9, 2023
Run yolov8 inference on Jetson nano unable to recognize gpu Jetson Nano yolo	7	2169	July 19, 2023
Yolo, Pytorch, TensorRT Torchvision installation on jetson nano Jetson Orin Nano pytorch	1	34	March 25, 2026
Problem in running yolov8 on gpu with pytorch cuda() Jetson Orin Nano yolo	4	811	April 11, 2024
NO WAY TO USE GPU - TORCH NOT DETECTING GPU - CUDA 12.6 - JP 6.1 ORIN NANO Jetson Orin Nano pytorch	5	88	March 24, 2026
RuntimeError: Couldn't load custom C++ ops. This can happen if your PyTorch and torchvision versions are incompatible, or if you had errors while com Jetson Orin NX camera , cuda , jetson-inference , yolo	9	2168	February 7, 2024
Install Pytorch with cuda on Jetson Orin nano Devloper Kit Jetson Orin Nano cuda , pytorch	13	4519	July 30, 2024
pyTorch GPU-activated in jetson orin nano Jetson Orin Nano pytorch	3	176	July 31, 2025
Error with PyTorch 2.0.0+nv23.05 and torchvision on Jetson Orin Nano - Compatibility Issue Jetson Orin Nano pytorch	2	174	March 31, 2025
Help with Pytorch, torchvision on Jetpack 6 Jetson Orin Nano pytorch	7	6816	March 5, 2024

Slow YOLOv8 inference speed in Jetson Orin Nano (had trouble with pytorch and torchvision installation)

Related topics