Hi
I’m trying to deploy EfficientViT-SAM model to Jetson Orin, as a TensorRT
So I’ve saved the pretrained model as a onnx file, and then tried to convert it into the TensorRT, .engine file, with trtexec, but it failed
I’ve followed the instructions here ( efficientvit/applications/efficientvit_sam/README.md at master · mit-han-lab/efficientvit · GitHub )
And I converted the original torch model into onnx at my desktop, and tried to convert onnx to engine in the Jestson Orin
When I see the log, it seems to have succeeded in generating the engine, but failed to save it as a file
I’ve already confirmed that trtexec has permission to write the file
I cannot find any clue for the reason why it failed to save it as a file, and I don’t know where I should start to investigate
Could you help me to resolve this issue?
Environment
TensorRT Version: 10.3.0
GPU Type: Jetson Orin AGX(6GB)
Nvidia Driver Version: 540.4.0
CUDA Version: 12.6
CUDNN Version:
Operating System + Version: ubuntu 22.04
Python Version (if applicable):
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):
Command
trtexec –verbose –allowGPUFallback –timingCacheFile=\~/trt/timing.cache –onnx=assets/export_models/efficientvit_sam/onnx/efficientvit_sam_l0_encoder.onnx –minShapes=input_image:1x3x512x512 –optShapes=input_imsage:4x3x512x512 –maxShapes=input_image:4x3x512x512 –saveEngine=\~/trt/efficientvit_sam_l0_encoder.engine ==exportProfile=\~/trt/efficientvit_sam_l0_encoder.trace.json
Part of the log
[01/23/2026-21:10:23] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 12 MiB, GPU 300 MiB
[01/23/2026-21:10:23] [V] [TRT] Adding 1 engine(s) to plan file.
[01/23/2026-21:10:23] [I] [TRT] [MemUsageStats] Peak memory usage during Engine building and serialization: CPU: 1758 MiB
[01/23/2026-21:10:23] [I] Engine built in 995.709 sec.
[01/23/2026-21:10:23] [I] Created engine with size: 119.411 MiB
[01/23/2026-21:10:23] [E] Saving engine to file failed.
[01/23/2026-21:10:23] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v100300] # /usr/src/tensorrt/bin/trtexec --verbose --allowGPUFallback --timingCacheFile=~/trt/timing.cache --onnx=assets/export_models/efficientvit_sam/onnx/efficientvit_sam_l0_encoder.onnx --minShapes=input_image:1x3x512x512 --optShapes=input_image:4x3x512x512 --maxShapes=input_image:4x3x512x512 --saveEngine=~/trt/efficientvit_sam_l0_encoder.engine --exportProfile=~/trt/efficientvit_sam_l0_encoder.trace.json
I would like to share the onnx file that I used, but it is blocked to upload any file in my organization, so it is hard to share it, sorry