SAM2 Segmentation on Jetson AGX Orin

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
, ,
1

I am running SAM2 on Jeston AGX Orin 64 Gb. I am only getting 2 FPS when segmenting frames. Does anyone have experience with running SAM2 on Jetson. I expected to get a higher FPS than this

SAM2 video annotation output

propagate in video: 100%|████████████████████████████████████████████████████████████████████████████████| 115/115 [00:46<00:00, 2.46it/s]

Tegrastats Output

02-25-2025 15:47:50 RAM 17492/62841MB (lfb 14x4MB) SWAP 0/31420MB (cached 0MB) CPU [7%@729,2%@729,3%@729,5%@729,5%@729,2%@729,23%@729,5%@729,2%@729,5%@729,7%@729,5%@729] GR3D_FREQ 99% cpu@53.531C soc2@50.593C soc0@50.781C gpu@54.281C tj@54.281C soc1@49.375C VDD_GPU_SOC 37170mW/37170mW VDD_CPU_CV 1599mW/1599mW VIN_SYS_5V0 8379mW/8379mW
02-25-2025 15:47:51 RAM 17487/62841MB (lfb 13x4MB) SWAP 0/31420MB (cached 0MB) CPU [8%@2201,2%@2201,1%@2201,12%@2201,2%@729,1%@729,23%@729,4%@729,6%@729,5%@729,5%@729,4%@729] GR3D_FREQ 99% cpu@53.625C soc2@50.812C soc0@50.718C gpu@54.343C tj@54.343C soc1@49.406C VDD_GPU_SOC 36770mW/36970mW VDD_CPU_CV 1200mW/1400mW VIN_SYS_5V0 7560mW/7970mW
02-25-2025 15:47:52 RAM 17501/62841MB (lfb 12x4MB) SWAP 0/31420MB (cached 0MB) CPU [6%@2201,2%@2201,2%@2201,1%@2201,4%@729,22%@729,2%@729,10%@729,6%@729,4%@729,8%@729,3%@729] GR3D_FREQ 72% cpu@53.75C soc2@50.656C soc0@50.875C gpu@52.781C tj@53.75C soc1@49.468C VDD_GPU_SOC 36785mW/36908mW VDD_CPU_CV 1200mW/1333mW VIN_SYS_5V0 7975mW/7971mW
02-25-2025 15:47:53 RAM 17504/62841MB (lfb 14x4MB) SWAP 0/31420MB (cached 0MB) CPU [6%@2201,2%@2201,2%@2201,4%@2201,2%@729,22%@729,2%@729,3%@729,1%@729,3%@729,5%@729,2%@729] GR3D_FREQ 99% cpu@53.593C soc2@51.031C soc0@51.062C gpu@55.156C tj@55.156C soc1@49.625C VDD_GPU_SOC 37170mW/36974mW VDD_CPU_CV 1200mW/1300mW VIN_SYS_5V0 8278mW/8048mW
02-25-2025 15:47:54 RAM 17565/62841MB (lfb 13x4MB) SWAP 0/31420MB (cached 0MB) CPU [8%@2201,4%@2201,26%@2201,7%@2201,6%@729,14%@729,2%@729,4%@729,14%@1497,4%@1497,9%@1497,5%@1497] GR3D_FREQ 99% cpu@54C soc2@50.75C soc0@50.968C gpu@53.406C tj@54C soc1@49.593C VDD_GPU_SOC 34386mW/36456mW VDD_CPU_CV 1600mW/1360mW VIN_SYS_5V0 7874mW/8013mW
02-25-2025 15:47:55 RAM 17563/62841MB (lfb 13x4MB) SWAP 0/31420MB (cached 0MB) CPU [7%@2201,1%@2201,3%@2201,17%@2201,4%@729,4%@729,2%@729,3%@729,5%@729,9%@729,3%@729,5%@729] GR3D_FREQ 100% cpu@53.781C soc2@51.25C soc0@51.25C gpu@55.062C tj@55.062C soc1@49.656C VDD_GPU_SOC 37170mW/36575mW VDD_CPU_CV 1200mW/1333mW VIN_SYS_5V0 7672mW/7956mW
02-25-2025 15:47:56 RAM 17567/62841MB (lfb 13x4MB) SWAP 0/31420MB (cached 0MB) CPU [10%@2201,3%@2201,3%@2201,21%@2201,4%@729,3%@729,4%@729,2%@729,0%@729,5%@729,7%@729,12%@729] GR3D_FREQ 99% cpu@54.062C soc2@50.781C soc0@50.968C gpu@53.031C tj@54.062C soc1@49.843C VDD_GPU_SOC 32400mW/35979mW VDD_CPU_CV 1600mW/1371mW VIN_SYS_5V0 7975mW/7959mW
02-25-2025 15:47:57 RAM 17576/62841MB (lfb 13x4MB) SWAP 0/31420MB (cached 0MB) CPU [5%@2201,4%@2201,1%@2201,18%@2201,3%@729,4%@729,3%@729,1%@729,2%@729,4%@729,5%@729,1%@729] GR3D_FREQ 99% cpu@54.031C soc2@51.218C soc0@51.437C gpu@54.531C tj@54.531C soc1@50.062C VDD_GPU_SOC 36356mW/36026mW VDD_CPU_CV 1200mW/1350mW VIN_SYS_5V0 8177mW/7986mW

3

Hi,

Please try to apply the below commands to maximize the device performance:

$ sudo nvpmodel -m 0
$ sudo jetson_clocks

Then please also run the tegrastats with sudo to show more GPU-related info (ex. GPU clock)

Thanks.

4

Hello, Could you please share more information how did you set up it on Jetson Orin 64 gb? I am facing the problem with Jetpack pytorch version compatibility with sam2. Thanks in advance.

5

Hi, please help to open a new topic for your issue, thanks.