Hi. I got the following error when converting D-FINE onnx model file into engine file due to lack of Grid sample.
Please let me hear the answers of the following questions.
-
It seems like JetPack 5.x or 6.x, TensorRT 8.5 or higher are needed. There is a way to install those version on Jetson nano?
-
If I can’t update the versions for them, can I use plugin file which provides grid sample to resolve the following error when converting onnx to engine file? If so, how to get that plugin file?
-
My goal is to run D-FINE-Nano detection model on Jetson nano. If there is any method to run it, please let me know.
root@b8dec3925ed8:/workspace/dfine/D-FINE-master# /workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx=“dfine_n_coco_final_v2.onnx” --saveEngine=“model.engine” --fp16
&&&& RUNNING TensorRT.trtexec [TensorRT v8201] # /workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx=dfine_n_coco_final_v2.onnx --saveEngine=model.engine --fp16
[11/16/2025-03:27:48] [I] === Model Options ===
[11/16/2025-03:27:48] [I] Format: ONNX
[11/16/2025-03:27:48] [I] Model: dfine_n_coco_final_v2.onnx
[11/16/2025-03:27:48] [I] Output:
[11/16/2025-03:27:48] [I] === Build Options ===
[11/16/2025-03:27:48] [I] Max batch: explicit batch
[11/16/2025-03:27:48] [I] Workspace: 16 MiB
[11/16/2025-03:27:48] [I] minTiming: 1
[11/16/2025-03:27:48] [I] avgTiming: 8
[11/16/2025-03:27:48] [I] Precision: FP32+FP16
[11/16/2025-03:27:48] [I] Calibration:
[11/16/2025-03:27:48] [I] Refit: Disabled
[11/16/2025-03:27:48] [I] Sparsity: Disabled
[11/16/2025-03:27:48] [I] Safe mode: Disabled
[11/16/2025-03:27:48] [I] DirectIO mode: Disabled
[11/16/2025-03:27:48] [I] Restricted mode: Disabled
[11/16/2025-03:27:48] [I] Save engine: model.engine
[11/16/2025-03:27:48] [I] Load engine:
[11/16/2025-03:27:48] [I] Profiling verbosity: 0
[11/16/2025-03:27:48] [I] Tactic sources: Using default tactic sources
[11/16/2025-03:27:48] [I] timingCacheMode: local
[11/16/2025-03:27:48] [I] timingCacheFile:
[11/16/2025-03:27:48] [I] Input(s)s format: fp32:CHW
[11/16/2025-03:27:48] [I] Output(s)s format: fp32:CHW
[11/16/2025-03:27:48] [I] Input build shapes: model
[11/16/2025-03:27:48] [I] Input calibration shapes: model
[11/16/2025-03:27:48] [I] === System Options ===
[11/16/2025-03:27:48] [I] Device: 0
[11/16/2025-03:27:48] [I] DLACore:
[11/16/2025-03:27:48] [I] Plugins:
[11/16/2025-03:27:48] [I] === Inference Options ===
[11/16/2025-03:27:48] [I] Batch: Explicit
[11/16/2025-03:27:48] [I] Input inference shapes: model
[11/16/2025-03:27:48] [I] Iterations: 10
[11/16/2025-03:27:48] [I] Duration: 3s (+ 200ms warm up)
[11/16/2025-03:27:48] [I] Sleep time: 0ms
[11/16/2025-03:27:48] [I] Idle time: 0ms
[11/16/2025-03:27:48] [I] Streams: 1
[11/16/2025-03:27:48] [I] ExposeDMA: Disabled
[11/16/2025-03:27:48] [I] Data transfers: Enabled
[11/16/2025-03:27:48] [I] Spin-wait: Disabled
[11/16/2025-03:27:48] [I] Multithreading: Disabled
[11/16/2025-03:27:48] [I] CUDA Graph: Disabled
[11/16/2025-03:27:48] [I] Separate profiling: Disabled
[11/16/2025-03:27:48] [I] Time Deserialize: Disabled
[11/16/2025-03:27:48] [I] Time Refit: Disabled
[11/16/2025-03:27:48] [I] Skip inference: Disabled
[11/16/2025-03:27:48] [I] Inputs:
[11/16/2025-03:27:48] [I] === Reporting Options ===
[11/16/2025-03:27:48] [I] Verbose: Disabled
[11/16/2025-03:27:48] [I] Averages: 10 inferences
[11/16/2025-03:27:48] [I] Percentile: 99
[11/16/2025-03:27:48] [I] Dump refittable layers:Disabled
[11/16/2025-03:27:48] [I] Dump output: Disabled
[11/16/2025-03:27:48] [I] Profile: Disabled
[11/16/2025-03:27:48] [I] Export timing to JSON file:
[11/16/2025-03:27:48] [I] Export output to JSON file:
[11/16/2025-03:27:48] [I] Export profile to JSON file:
[11/16/2025-03:27:48] [I]
[11/16/2025-03:27:48] [I] === Device Information ===
[11/16/2025-03:27:48] [I] Selected Device: NVIDIA Tegra X1
[11/16/2025-03:27:48] [I] Compute Capability: 5.3
[11/16/2025-03:27:48] [I] SMs: 1
[11/16/2025-03:27:48] [I] Compute Clock Rate: 0.9216 GHz
[11/16/2025-03:27:48] [I] Device Global Memory: 3963 MiB
[11/16/2025-03:27:48] [I] Shared Memory per SM: 64 KiB
[11/16/2025-03:27:48] [I] Memory Bus Width: 64 bits (ECC disabled)
[11/16/2025-03:27:48] [I] Memory Clock Rate: 0.01275 GHz
[11/16/2025-03:27:48] [I]
[11/16/2025-03:27:48] [I] TensorRT version: 8.2.1
[11/16/2025-03:27:50] [I] [TRT] [MemUsageChange] Init CUDA: CPU +230, GPU +0, now: CPU 248, GPU 2578 (MiB)
[11/16/2025-03:27:51] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 248 MiB, GPU 2578 MiB
[11/16/2025-03:27:51] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 277 MiB, GPU 2608 MiB
[11/16/2025-03:27:51] [I] Start parsing network model
[11/16/2025-03:27:51] [I] [TRT] ----------------------------------------------------------------
[11/16/2025-03:27:51] [I] [TRT] Input filename: dfine_n_coco_final_v2.onnx
[11/16/2025-03:27:51] [I] [TRT] ONNX IR version: 0.0.8
[11/16/2025-03:27:51] [I] [TRT] Opset version: 16
[11/16/2025-03:27:51] [I] [TRT] Producer name: pytorch
[11/16/2025-03:27:51] [I] [TRT] Producer version: 2.0.1
[11/16/2025-03:27:51] [I] [TRT] Domain:
[11/16/2025-03:27:51] [I] [TRT] Model version: 0
[11/16/2025-03:27:51] [I] [TRT] Doc string:
[11/16/2025-03:27:51] [I] [TRT] ----------------------------------------------------------------
[11/16/2025-03:27:51] [W] [TRT] onnx2trt_utils.cpp:366: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[11/16/2025-03:27:51] [W] [TRT] onnx2trt_utils.cpp:392: One or more weights outside the range of INT32 was clamped
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] No importer registered for op: GridSample. Attempting to import as plugin.
[11/16/2025-03:27:53] [I] [TRT] Searching for plugin: GridSample, plugin_version: 1, plugin_namespace:
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:773: While parsing node number 418 [GridSample → “/model/decoder/decoder/layers.0/cross_attn/GridSample_output_0”]:
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:774: — Begin node —
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:775: input: “/model/decoder/decoder/layers.0/cross_attn/Reshape_3_output_0”
input: “/model/decoder/decoder/layers.0/cross_attn/Split_output_0”
output: “/model/decoder/decoder/layers.0/cross_attn/GridSample_output_0”
name: “/model/decoder/decoder/layers.0/cross_attn/GridSample”
op_type: “GridSample”
attribute {
name: “align_corners”
i: 0
type: INT
}
attribute {
name: “mode”
s: “bilinear”
type: STRING
}
attribute {
name: “padding_mode”
s: “zeros”
type: STRING
}
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:776: — End node —
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:779: ERROR: builtin_op_importers.cpp:4870 In function importFallbackPluginImporter:
[8] Assertion failed: creator && “Plugin not found, are the plugin name, version, and namespace correct?”
[11/16/2025-03:27:53] [E] Failed to parse onnx file
[11/16/2025-03:27:53] [I] Finish parsing network model
[11/16/2025-03:27:53] [E] Parsing model failed
[11/16/2025-03:27:53] [E] Failed to create engine from model.
[11/16/2025-03:27:53] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8201] # /workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx=dfine_n_coco_final_v2.onnx --saveEngine=model.engine --fp16
‘‘‘