ONNX to TensorRT conversion

aryan.tomar.20031 · June 12, 2024, 12:50pm

I am converting my ONNX model to TensorRT, but getting the below error mesage

Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
06/12/2024-16:53:18] [E] Error[1]: [network.cpp::setWeightsName::3366] Error Code 1: Internal Error (Error: Weights of same values but of different types are used in the network!)
[06/12/2024-16:53:18] [E] [TRT] ModelImporter.cpp:726: While parsing node number 396 [ConstantOfShape -> "/model/rpn/anchor_generator/ConstantOfShape_output_0"]:
[06/12/2024-16:53:18] [E] [TRT] ModelImporter.cpp:727: --- Begin node ---
[06/12/2024-16:53:18] [E] [TRT] ModelImporter.cpp:728: input: "/model/rpn/anchor_generator/Constant_12_output_0"
output: "/model/rpn/anchor_generator/ConstantOfShape_output_0"
name: "/model/rpn/anchor_generator/ConstantOfShape"
op_type: "ConstantOfShape"
attribute {
  name: "value"
  t {
    dims: 1
    data_type: 7
    name: ""
    raw_data: "\000\000\000\000\000\000\000\000"
  }
  type: TENSOR
}

[06/12/2024-16:53:18] [E] [TRT] ModelImporter.cpp:729: --- End node ---
[06/12/2024-16:53:18] [E] [TRT] ModelImporter.cpp:731: ERROR: ModelImporter.cpp:172 In function parseGraph:
[6] Invalid Node - /model/rpn/anchor_generator/ConstantOfShape
[network.cpp::setWeightsName::3366] Error Code 1: Internal Error (Error: Weights of same values but of different types are used in the network!)
[06/12/2024-16:53:18] [E] Failed to parse onnx file
[06/12/2024-16:53:18] [I] Finish parsing network model
[06/12/2024-16:53:18] [E] Parsing model failed
[06/12/2024-16:53:18] [E] Failed to create engine from model or file.
[06/12/2024-16:53:18] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=folded.onnx --saveEngine=pll.engine

I created my ONNX from .pth model (checked all parameters and buffers of .pth, found no INT64).

I tried folding the model using polygraphy surgeon sanitize --fold-constants -o folded.onnx torch_model_to_onnx.onnx the error was still same.

I changed opset_version to 12, 14, and16 but the error was still same.

Please provide a solution.

SivaRamaKrishnaNV · June 13, 2024, 7:54am

Dear @aryan.tomar.20031,
May I know the Jetpack version. Assuming the used target is Jetson Nano. Can you share the ONNX model and trtexec verbose log?

aryan.tomar.20031 · June 13, 2024, 12:03pm

Jetpack version - 5.5.1
Issue that we’re facing


&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=torch_model_to_onnx.onnx --saveEngine=torch_model_to_trt.engine --verbose
[06/13/2024-17:26:38] [I] === Model Options ===
[06/13/2024-17:26:38] [I] Format: ONNX
[06/13/2024-17:26:38] [I] Model: torch_model_to_onnx.onnx
[06/13/2024-17:26:38] [I] Output:
[06/13/2024-17:26:38] [I] === Build Options ===
[06/13/2024-17:26:38] [I] Max batch: explicit batch
[06/13/2024-17:26:38] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[06/13/2024-17:26:38] [I] minTiming: 1
[06/13/2024-17:26:38] [I] avgTiming: 8
[06/13/2024-17:26:38] [I] Precision: FP32
[06/13/2024-17:26:38] [I] LayerPrecisions: 
[06/13/2024-17:26:38] [I] Calibration: 
[06/13/2024-17:26:38] [I] Refit: Disabled
[06/13/2024-17:26:38] [I] Sparsity: Disabled
[06/13/2024-17:26:38] [I] Safe mode: Disabled
[06/13/2024-17:26:38] [I] DirectIO mode: Disabled
[06/13/2024-17:26:38] [I] Restricted mode: Disabled
[06/13/2024-17:26:38] [I] Build only: Disabled
[06/13/2024-17:26:38] [I] Save engine: torch_model_to_trt.engine
[06/13/2024-17:26:38] [I] Load engine: 
[06/13/2024-17:26:38] [I] Profiling verbosity: 0
[06/13/2024-17:26:38] [I] Tactic sources: Using default tactic sources
[06/13/2024-17:26:38] [I] timingCacheMode: local
[06/13/2024-17:26:38] [I] timingCacheFile: 
[06/13/2024-17:26:38] [I] Heuristic: Disabled
[06/13/2024-17:26:38] [I] Preview Features: Use default preview flags.
[06/13/2024-17:26:38] [I] Input(s)s format: fp32:CHW
[06/13/2024-17:26:38] [I] Output(s)s format: fp32:CHW
[06/13/2024-17:26:38] [I] Input build shapes: model
[06/13/2024-17:26:38] [I] Input calibration shapes: model
[06/13/2024-17:26:38] [I] === System Options ===
[06/13/2024-17:26:38] [I] Device: 0
[06/13/2024-17:26:38] [I] DLACore: 
[06/13/2024-17:26:38] [I] Plugins:
[06/13/2024-17:26:38] [I] === Inference Options ===
[06/13/2024-17:26:38] [I] Batch: Explicit
[06/13/2024-17:26:38] [I] Input inference shapes: model
[06/13/2024-17:26:38] [I] Iterations: 10
[06/13/2024-17:26:38] [I] Duration: 3s (+ 200ms warm up)
[06/13/2024-17:26:38] [I] Sleep time: 0ms
[06/13/2024-17:26:38] [I] Idle time: 0ms
[06/13/2024-17:26:38] [I] Streams: 1
[06/13/2024-17:26:38] [I] ExposeDMA: Disabled
[06/13/2024-17:26:38] [I] Data transfers: Enabled
[06/13/2024-17:26:38] [I] Spin-wait: Disabled
[06/13/2024-17:26:38] [I] Multithreading: Disabled
[06/13/2024-17:26:38] [I] CUDA Graph: Disabled
[06/13/2024-17:26:38] [I] Separate profiling: Disabled
[06/13/2024-17:26:38] [I] Time Deserialize: Disabled
[06/13/2024-17:26:38] [I] Time Refit: Disabled
[06/13/2024-17:26:38] [I] NVTX verbosity: 0
[06/13/2024-17:26:38] [I] Persistent Cache Ratio: 0
[06/13/2024-17:26:38] [I] Inputs:
[06/13/2024-17:26:38] [I] === Reporting Options ===
[06/13/2024-17:26:38] [I] Verbose: Enabled
[06/13/2024-17:26:38] [I] Averages: 10 inferences
[06/13/2024-17:26:38] [I] Percentiles: 90,95,99
[06/13/2024-17:26:38] [I] Dump refittable layers:Disabled
[06/13/2024-17:26:38] [I] Dump output: Disabled
[06/13/2024-17:26:38] [I] Profile: Disabled
[06/13/2024-17:26:38] [I] Export timing to JSON file: 
[06/13/2024-17:26:38] [I] Export output to JSON file: 
[06/13/2024-17:26:38] [I] Export profile to JSON file: 
[06/13/2024-17:26:38] [I] 
[06/13/2024-17:26:38] [I] === Device Information ===
[06/13/2024-17:26:38] [I] Selected Device: Orin
[06/13/2024-17:26:38] [I] Compute Capability: 8.7
[06/13/2024-17:26:38] [I] SMs: 8
[06/13/2024-17:26:38] [I] Compute Clock Rate: 0.624 GHz
[06/13/2024-17:26:38] [I] Device Global Memory: 6480 MiB
[06/13/2024-17:26:38] [I] Shared Memory per SM: 164 KiB
[06/13/2024-17:26:38] [I] Memory Bus Width: 64 bits (ECC disabled)
[06/13/2024-17:26:38] [I] Memory Clock Rate: 0.624 GHz
[06/13/2024-17:26:38] [I] 
[06/13/2024-17:26:38] [I] TensorRT version: 8.5.2
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::GroupNorm version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::LayerNorm version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Proposal version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::ROIAlign_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::SeqLen2Spatial version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::SplitGeLU version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::Split version 1
[06/13/2024-17:26:38] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1
[06/13/2024-17:26:39] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 249, GPU 4056 (MiB)
[06/13/2024-17:26:39] [V] [TRT] Trying to load shared library libnvinfer_builder_resource.so.8.5.2
[06/13/2024-17:26:39] [V] [TRT] Loaded shared library libnvinfer_builder_resource.so.8.5.2
[06/13/2024-17:26:42] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +266, now: CPU 574, GPU 4344 (MiB)
[06/13/2024-17:26:42] [I] Start parsing network model
[06/13/2024-17:26:42] [I] [TRT] ----------------------------------------------------------------
[06/13/2024-17:26:42] [I] [TRT] Input filename:   torch_model_to_onnx.onnx
[06/13/2024-17:26:42] [I] [TRT] ONNX IR version:  0.0.7
[06/13/2024-17:26:42] [I] [TRT] Opset version:    12
[06/13/2024-17:26:42] [I] [TRT] Producer name:    pytorch
[06/13/2024-17:26:42] [I] [TRT] Producer version: 1.14.0
[06/13/2024-17:26:42] [I] [TRT] Domain:           
[06/13/2024-17:26:42] [I] [TRT] Model version:    0
[06/13/2024-17:26:42] [I] [TRT] Doc string:       
[06/13/2024-17:26:42] [I] [TRT] ----------------------------------------------------------------
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::GroupNorm version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::LayerNorm version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::ROIAlign_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::SeqLen2Spatial version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::SplitGeLU version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::Split version 1
[06/13/2024-17:26:42] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1
[06/13/2024-17:26:42] [V] [TRT] Adding network input: images with dtype: float32, dimensions: (1, 1, 256, 256)
[06/13/2024-17:26:42] [V] [TRT] Registering tensor: images for ONNX tensor: images
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.0.downsample.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.1.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer1.2.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.0.downsample.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.1.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.2.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer2.3.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.0.downsample.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.1.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.2.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.3.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.4.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer3.5.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.0.downsample.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.1.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv1.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv2.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.body.layer4.2.conv3.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.0.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.0.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.1.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.1.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.2.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.2.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.3.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.inner_blocks.3.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.0.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.0.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.1.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.1.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.2.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.2.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.3.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.backbone.fpn.layer_blocks.3.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.conv.0.0.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.conv.0.0.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.cls_logits.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.cls_logits.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.bbox_pred.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.rpn.head.bbox_pred.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_head.fc6.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_head.fc6.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_head.fc7.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_head.fc7.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_predictor.cls_score.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_predictor.cls_score.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_predictor.bbox_pred.weight
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: model.roi_heads.box_predictor.bbox_pred.bias
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3104
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3106
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3114
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3116
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3124
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3126
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3134
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3136
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3144
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3146
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3154
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3156
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3164
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3166
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3174
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3176
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3184
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3186
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3194
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3196
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3204
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3206
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3214
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3216
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3224
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3226
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3234
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3236
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3244
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3246
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3254
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3256
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3264
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3266
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3274
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3276
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3284
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3286
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3294
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3296
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3304
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3306
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3314
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3316
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3324
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3326
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3334
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3336
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3344
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3346
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3354
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3356
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3364
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3366
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3374
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3376
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3384
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3386
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3394
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3396
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3404
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3406
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3414
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3416
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3424
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3426
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3434
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3436
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3444
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3446
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3454
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3456
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3464
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3466
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3474
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3476
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3484
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3486
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3494
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3496
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3504
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3506
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3514
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3516
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3524
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3526
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3534
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3536
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3544
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3546
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3554
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3556
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3564
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3566
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3574
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3576
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3584
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3586
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3594
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3596
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3604
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3606
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3614
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3616
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Mul_3624
[06/13/2024-17:26:42] [V] [TRT] Importing initializer: onnx::Add_3626

on repeat

[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Constant_8_output_0 for ONNX node: /model/rpn/anchor_generator/Constant_8_output_0
[06/13/2024-17:26:43] [V] [TRT] Using Gather axis: 0
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Gather_8 for ONNX node: /model/rpn/anchor_generator/Gather_8
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Gather_8_output_0 for ONNX tensor: /model/rpn/anchor_generator/Gather_8_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_8 [Gather] outputs: [/model/rpn/anchor_generator/Gather_8_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Shape_9 [Shape]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/backbone/fpn/extra_blocks/MaxPool_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_9 [Shape] inputs: [/model/backbone/fpn/extra_blocks/MaxPool_output_0 -> (1, 256, 13, 13)[FLOAT]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Shape_9 for ONNX node: /model/rpn/anchor_generator/Shape_9
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Shape_9_output_0 for ONNX tensor: /model/rpn/anchor_generator/Shape_9_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_9 [Shape] outputs: [/model/rpn/anchor_generator/Shape_9_output_0 -> (4)[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Constant_9 [Constant]
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_9 [Constant] inputs: 
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_9 [Constant] outputs: [/model/rpn/anchor_generator/Constant_9_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Gather_9 [Gather]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Shape_9_output_0
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Constant_9_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_9 [Gather] inputs: [/model/rpn/anchor_generator/Shape_9_output_0 -> (4)[INT32]], [/model/rpn/anchor_generator/Constant_9_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Constant_9_output_0 for ONNX node: /model/rpn/anchor_generator/Constant_9_output_0
[06/13/2024-17:26:43] [V] [TRT] Using Gather axis: 0
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Gather_9 for ONNX node: /model/rpn/anchor_generator/Gather_9
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Gather_9_output_0 for ONNX tensor: /model/rpn/anchor_generator/Gather_9_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_9 [Gather] outputs: [/model/rpn/anchor_generator/Gather_9_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Shape_10 [Shape]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/transform/Concat_8_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_10 [Shape] inputs: [/model/transform/Concat_8_output_0 -> (1, 3, 800, 800)[FLOAT]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Shape_10 for ONNX node: /model/rpn/anchor_generator/Shape_10
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Shape_10_output_0 for ONNX tensor: /model/rpn/anchor_generator/Shape_10_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_10 [Shape] outputs: [/model/rpn/anchor_generator/Shape_10_output_0 -> (4)[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Constant_10 [Constant]
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_10 [Constant] inputs: 
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_10 [Constant] outputs: [/model/rpn/anchor_generator/Constant_10_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Gather_10 [Gather]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Shape_10_output_0
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Constant_10_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_10 [Gather] inputs: [/model/rpn/anchor_generator/Shape_10_output_0 -> (4)[INT32]], [/model/rpn/anchor_generator/Constant_10_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Constant_10_output_0 for ONNX node: /model/rpn/anchor_generator/Constant_10_output_0
[06/13/2024-17:26:43] [V] [TRT] Using Gather axis: 0
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Gather_10 for ONNX node: /model/rpn/anchor_generator/Gather_10
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Gather_10_output_0 for ONNX tensor: /model/rpn/anchor_generator/Gather_10_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_10 [Gather] outputs: [/model/rpn/anchor_generator/Gather_10_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Shape_11 [Shape]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/transform/Concat_8_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_11 [Shape] inputs: [/model/transform/Concat_8_output_0 -> (1, 3, 800, 800)[FLOAT]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Shape_11 for ONNX node: /model/rpn/anchor_generator/Shape_11
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Shape_11_output_0 for ONNX tensor: /model/rpn/anchor_generator/Shape_11_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Shape_11 [Shape] outputs: [/model/rpn/anchor_generator/Shape_11_output_0 -> (4)[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Constant_11 [Constant]
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_11 [Constant] inputs: 
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_11 [Constant] outputs: [/model/rpn/anchor_generator/Constant_11_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Gather_11 [Gather]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Shape_11_output_0
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Constant_11_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_11 [Gather] inputs: [/model/rpn/anchor_generator/Shape_11_output_0 -> (4)[INT32]], [/model/rpn/anchor_generator/Constant_11_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Constant_11_output_0 for ONNX node: /model/rpn/anchor_generator/Constant_11_output_0
[06/13/2024-17:26:43] [V] [TRT] Using Gather axis: 0
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Gather_11 for ONNX node: /model/rpn/anchor_generator/Gather_11
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Gather_11_output_0 for ONNX tensor: /model/rpn/anchor_generator/Gather_11_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Gather_11 [Gather] outputs: [/model/rpn/anchor_generator/Gather_11_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Div [Div]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Gather_10_output_0
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Gather_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Div [Div] inputs: [/model/rpn/anchor_generator/Gather_10_output_0 -> ()[INT32]], [/model/rpn/anchor_generator/Gather_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Div for ONNX node: /model/rpn/anchor_generator/Div
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Div_output_0 for ONNX tensor: /model/rpn/anchor_generator/Div_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Div [Div] outputs: [/model/rpn/anchor_generator/Div_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Cast [Cast]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Div_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Cast [Cast] inputs: [/model/rpn/anchor_generator/Div_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Casting to type: int32
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Cast for ONNX node: /model/rpn/anchor_generator/Cast
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Cast_output_0 for ONNX tensor: /model/rpn/anchor_generator/Cast_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Cast [Cast] outputs: [/model/rpn/anchor_generator/Cast_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Cast_1 [Cast]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Cast_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Cast_1 [Cast] inputs: [/model/rpn/anchor_generator/Cast_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Casting to type: int32
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/Cast_1 for ONNX node: /model/rpn/anchor_generator/Cast_1
[06/13/2024-17:26:43] [V] [TRT] Registering tensor: /model/rpn/anchor_generator/Cast_1_output_0 for ONNX tensor: /model/rpn/anchor_generator/Cast_1_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Cast_1 [Cast] outputs: [/model/rpn/anchor_generator/Cast_1_output_0 -> ()[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/Constant_12 [Constant]
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_12 [Constant] inputs: 
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/Constant_12 [Constant] outputs: [/model/rpn/anchor_generator/Constant_12_output_0 -> (0)[INT32]], 
[06/13/2024-17:26:43] [V] [TRT] Parsing node: /model/rpn/anchor_generator/ConstantOfShape [ConstantOfShape]
[06/13/2024-17:26:43] [V] [TRT] Searching for input: /model/rpn/anchor_generator/Constant_12_output_0
[06/13/2024-17:26:43] [V] [TRT] /model/rpn/anchor_generator/ConstantOfShape [ConstantOfShape] inputs: [/model/rpn/anchor_generator/Constant_12_output_0 -> (0)[INT32]], 
[06/13/2024-17:26:43] [E] Error[1]: [network.cpp::setWeightsName::3366] Error Code 1: Internal Error (Error: Weights of same values but of different types are used in the network!)
[06/13/2024-17:26:43] [V] [TRT] Registering layer: /model/rpn/anchor_generator/ConstantOfShape for ONNX node: /model/rpn/anchor_generator/ConstantOfShape
[06/13/2024-17:26:43] [E] [TRT] ModelImporter.cpp:726: While parsing node number 477 [ConstantOfShape -> "/model/rpn/anchor_generator/ConstantOfShape_output_0"]:
[06/13/2024-17:26:43] [E] [TRT] ModelImporter.cpp:727: --- Begin node ---
[06/13/2024-17:26:43] [E] [TRT] ModelImporter.cpp:728: input: "/model/rpn/anchor_generator/Constant_12_output_0"
output: "/model/rpn/anchor_generator/ConstantOfShape_output_0"
name: "/model/rpn/anchor_generator/ConstantOfShape"
op_type: "ConstantOfShape"
attribute {
  name: "value"
  t {
    dims: 1
    data_type: 7
    raw_data: "\000\000\000\000\000\000\000\000"
  }
  type: TENSOR
}

[06/13/2024-17:26:43] [E] [TRT] ModelImporter.cpp:729: --- End node ---
[06/13/2024-17:26:43] [E] [TRT] ModelImporter.cpp:731: ERROR: ModelImporter.cpp:172 In function parseGraph:
[6] Invalid Node - /model/rpn/anchor_generator/ConstantOfShape
[network.cpp::setWeightsName::3366] Error Code 1: Internal Error (Error: Weights of same values but of different types are used in the network!)
[06/13/2024-17:26:43] [E] Failed to parse onnx file
[06/13/2024-17:26:43] [I] Finish parsing network model
[06/13/2024-17:26:43] [E] Parsing model failed
[06/13/2024-17:26:43] [E] Failed to create engine from model or file.
[06/13/2024-17:26:43] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=torch_model_to_onnx.onnx --saveEngine=torch_model_to_trt.engine --verbose

Sorry I can’t share the model link, it’s trained on licensed data.

SivaRamaKrishnaNV · June 18, 2024, 4:52am

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

Dear @aryan.tomar.20031,
Is it possible to share a simple model which can repro issue?