I’m trying to get Meta’s SAM2 model running in my Jetson, the model is published at: [image] GitHub - facebookresearch/segment-anything-2: The repository provides code for running inference... The repository provides code for running inference with the Meta Segment Anything Model…

Thanks for your interest in it @user93959 , historically that looked like trying to export the model from PyTorch to ONNX and run it with TensorRT (or using torch2trt). However Transformer-based models are so much larger that it requires different techniques, including the use of other quantization…

@user93959 have not been able to try SAM2 yet, but looks like an exciting model! If you get it working, I’m sure the community would appreciate sharing your results. You may need to work through some install things when trying them on Jetson aarch64+CUDA architecture (which we have many dockerfil…

I should’ve mentioned in the post, I’ll edit right away, but cuda 12.2 is installed at the specific location, and I manually set CUDA_HOME, even as a global variable in case pip was doing something with users.

I did that, downloaded the wheels from the documentation link for both PyTorch and Vision, I also made sure it works fine by running some DeepStream sample apps and trying few Python codes that runs CUDA with Pytorch.

@user93959 if you are still facing the issue, I would dig into the code and start patching/printing debug info to see why it throws that error during setup. Sometimes new packages may require some workarounds for aarch64. Also it is unclear why your torch/utils/cpp_extension.py file would be under…

I noticed that SAM2 requires torch>=2.3.1, torchvision>=0.18.1, so I updated torch to 2.4.0, and now I’m working on updating torchvision to 0.19 and see if that does it.

Sometimes the requirements.txt just says that or was frozen with it, but does not actually require it, and by virtue of changing around all the versions the CUDA-enabled builds of them get uninstalled/replaced. It sounds like you are already confirming that GPU still works in these after the setup …

Hey, I am trying to do the same thing, but no success so far

The github installation section mentions: The code requires python>=3.10, as well as torch>=2.3.1 and torchvision>=0.18.1 I installed torch 2.4.0 but having issues building torchvision 0.19 or 0.18.1, would you happen to have pre-built wheels I can install?

[image] user93959: I installed torch 2.4.0 but having issues building torchvision 0.19 or 0.18.1, would you happen to have pre-built wheels I can install? Hi @user93959 , I have torchvision 0.18 wheel here for JP6 / CUDA 12.2, perhaps that could work for you - http://jetson.webredirect.org/jp6…

Unable to install SAM2 on Orin Nano

Robotics & Edge Computing Jetson Systems Jetson Orin Nano

dusty_nv August 3, 2024, 1:45am 5

It looks like it may be encountering that error building a PyTorch extension. Beforehand did you install one of the PyTorch wheels built for Jetson, like from this topic:

Topic		Replies	Views
Error while building the NanoSAM jetson container Jetson Orin Nano tensorrt	7	372	March 10, 2025
Jetson-containers Error: Unexpected error from cudaGetDeviceCount() Jetson Orin Nano containers	11	314	October 8, 2025
Nvidia Jetson Orin Nano Developer Kit : Vision Transfomer: NanoSAM and Computer Vision : Unable to Install nanosam Jetson Orin Nano jetson , jetson-nano , computer-vision	9	193	March 5, 2025
CUDA error: no kernel image is available for execution on the device Jetson Orin Nano cuda , python	5	5478	June 17, 2024
Jetson Orin Nano Setup disaster Jetson Orin Nano pytorch	12	505	September 17, 2025
Torch on Jetson Orin Nano Jetpack 6.2.1 Jetson Orin Nano cuda , pytorch , gpu	10	161	March 24, 2026
SAM (Segmentation Anywhere) Jetson Orin Nano jetson-inference	5	738	September 18, 2025
Install Pytorch with cuda on Jetson Orin nano Devloper Kit Jetson Orin Nano cuda , pytorch	13	4531	July 30, 2024
Announcement: All you need is a Jetson Jetson Projects generative_ai	1	840	October 6, 2023
Issue installing Pytorch on Jetson Orin Nano with Jetpack 6.0 Jetson Orin NX cuda , pytorch , jetson , jetson-orin	9	677	November 25, 2024

Unable to install SAM2 on Orin Nano

Related topics