Step-wise procedure to deploy a custom tensorflow 2.4 object detection model in deepstream 5.1

Description

I need a step wise procedure to deploy a single class custom trained tf 2.4 object detection ssd mobilenet v2 fpn 640*640 model in deepstream 5.1. Since i am new to this i will also need assistance in deploying for real time stream.

Environment

I am using jetpack 4.5.1 in jetson nano.

Relevant Files

i have successfully trained and exported the frozen graph for the model.
I have also done the inference from the .ckpt and .pb file achieving 5 FPS in jetson nano.
I need this to be faster in real time so need these steps to achieve that.

Kindly request to provide all the required posts, forum discussions etc for this.

Thanks in advance.

Hi,

There are some tutorials shared by our user.
For example, please check if below page can meet your requirement:

Thanks.

Thanks @AastaLLL . I have looked into this but this is for tf 1.14 and after going through some of the developer forum topics I came to know that the procedure for tf 2.4 models is different. So kindly make this clear.
Thanks

Hi,

For TensorFlow 2.x, please convert the model into ONNX format and update the deepstream path accordingly.
You can check below converter to generate an ONNX model:

Thanks.

Hi @AastaLLL. I was able to convert the custom tf2.4 .pb model to .onnx as you suggested but then i followed up the forum for the next steps but it has to be converted in to .engine (tensorrt) and then deploy in deepstream 5.1. Could you please help me out for these steps as i am facing some difficulty to understand? The steps from conversion to trt engine and running in deepstream on a sample video.

Thanks
Dhiraj

HI @AastaLLL
I came to know that first i need to check if the onnx model is trt compatible or not from this: Onnx model on deepstream5.0: Nvinfer error: Could not find NMS layer buffer while parsing.
Then when its compatible i need to make a custom parser for the bounding box data. Then i need to make changes in the config file. Then i can run it in deepstream.
Now the issue i am facing is ::

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/nano/tfobjectdetection/workspace/fp16model.onnx
[04/19/2021-23:06:42] [I] === Model Options ===
[04/19/2021-23:06:42] [I] Format: ONNX
[04/19/2021-23:06:42] [I] Model: /home/nano/tfobjectdetection/workspace/fp16model.onnx
[04/19/2021-23:06:42] [I] Output:
[04/19/2021-23:06:42] [I] === Build Options ===
[04/19/2021-23:06:42] [I] Max batch: 1
[04/19/2021-23:06:42] [I] Workspace: 16 MB
[04/19/2021-23:06:42] [I] minTiming: 1
[04/19/2021-23:06:42] [I] avgTiming: 8
[04/19/2021-23:06:42] [I] Precision: FP32
[04/19/2021-23:06:42] [I] Calibration:
[04/19/2021-23:06:42] [I] Safe mode: Disabled
[04/19/2021-23:06:42] [I] Save engine:
[04/19/2021-23:06:42] [I] Load engine:
[04/19/2021-23:06:42] [I] Builder Cache: Enabled
[04/19/2021-23:06:42] [I] NVTX verbosity: 0
[04/19/2021-23:06:42] [I] Inputs format: fp32:CHW
[04/19/2021-23:06:42] [I] Outputs format: fp32:CHW
[04/19/2021-23:06:42] [I] Input build shapes: model
[04/19/2021-23:06:42] [I] Input calibration shapes: model
[04/19/2021-23:06:42] [I] === System Options ===
[04/19/2021-23:06:42] [I] Device: 0
[04/19/2021-23:06:42] [I] DLACore:
[04/19/2021-23:06:42] [I] Plugins:
[04/19/2021-23:06:42] [I] === Inference Options ===
[04/19/2021-23:06:42] [I] Batch: 1
[04/19/2021-23:06:42] [I] Input inference shapes: model
[04/19/2021-23:06:42] [I] Iterations: 10
[04/19/2021-23:06:42] [I] Duration: 3s (+ 200ms warm up)
[04/19/2021-23:06:42] [I] Sleep time: 0ms
[04/19/2021-23:06:42] [I] Streams: 1
[04/19/2021-23:06:42] [I] ExposeDMA: Disabled
[04/19/2021-23:06:42] [I] Spin-wait: Disabled
[04/19/2021-23:06:42] [I] Multithreading: Disabled
[04/19/2021-23:06:42] [I] CUDA Graph: Disabled
[04/19/2021-23:06:42] [I] Skip inference: Disabled
[04/19/2021-23:06:42] [I] Inputs:
[04/19/2021-23:06:42] [I] === Reporting Options ===
[04/19/2021-23:06:42] [I] Verbose: Disabled
[04/19/2021-23:06:42] [I] Averages: 10 inferences
[04/19/2021-23:06:42] [I] Percentile: 99
[04/19/2021-23:06:42] [I] Dump output: Disabled
[04/19/2021-23:06:42] [I] Profile: Disabled
[04/19/2021-23:06:42] [I] Export timing to JSON file:
[04/19/2021-23:06:42] [I] Export output to JSON file:
[04/19/2021-23:06:42] [I] Export profile to JSON file:
[04/19/2021-23:06:42] [I]

Input filename: /home/nano/tfobjectdetection/workspace/fp16model.onnx
ONNX IR version: 0.0.7
Opset version: 13
Producer name:
Producer version:
Domain:
Model version: 0
Doc string:

[04/19/2021-23:06:44] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[04/19/2021-23:06:44] [W] [TRT] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
terminate called after throwing an instance of ‘std::out_of_range’
what(): Attribute not found: axes
Aborted (core dumped)

How do i solve this??

After going through this:: Deploying Tensorflow Model on Jetson Xavier NX: onnx to tensorrt - #4 by AastaLLL

I reinstalled the newest version of onnx-tensorrt and then tried out the compatibility again which gave this:;

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/nano/tfobjectdetection/workspace/fp16model.onnx --verbose
[04/20/2021-01:10:00] [I] === Model Options ===
[04/20/2021-01:10:00] [I] Format: ONNX
[04/20/2021-01:10:00] [I] Model: /home/nano/tfobjectdetection/workspace/fp16model.onnx
[04/20/2021-01:10:00] [I] Output:
[04/20/2021-01:10:00] [I] === Build Options ===
[04/20/2021-01:10:00] [I] Max batch: 1
[04/20/2021-01:10:00] [I] Workspace: 16 MB
[04/20/2021-01:10:00] [I] minTiming: 1
[04/20/2021-01:10:00] [I] avgTiming: 8
[04/20/2021-01:10:00] [I] Precision: FP32
[04/20/2021-01:10:00] [I] Calibration:
[04/20/2021-01:10:00] [I] Safe mode: Disabled
[04/20/2021-01:10:00] [I] Save engine:
[04/20/2021-01:10:00] [I] Load engine:
[04/20/2021-01:10:00] [I] Builder Cache: Enabled
[04/20/2021-01:10:00] [I] NVTX verbosity: 0
[04/20/2021-01:10:00] [I] Inputs format: fp32:CHW
[04/20/2021-01:10:00] [I] Outputs format: fp32:CHW
[04/20/2021-01:10:00] [I] Input build shapes: model
[04/20/2021-01:10:00] [I] Input calibration shapes: model
[04/20/2021-01:10:00] [I] === System Options ===
[04/20/2021-01:10:00] [I] Device: 0
[04/20/2021-01:10:00] [I] DLACore:
[04/20/2021-01:10:00] [I] Plugins:
[04/20/2021-01:10:00] [I] === Inference Options ===
[04/20/2021-01:10:00] [I] Batch: 1
[04/20/2021-01:10:00] [I] Input inference shapes: model
[04/20/2021-01:10:00] [I] Iterations: 10
[04/20/2021-01:10:00] [I] Duration: 3s (+ 200ms warm up)
[04/20/2021-01:10:00] [I] Sleep time: 0ms
[04/20/2021-01:10:00] [I] Streams: 1
[04/20/2021-01:10:00] [I] ExposeDMA: Disabled
[04/20/2021-01:10:00] [I] Spin-wait: Disabled
[04/20/2021-01:10:00] [I] Multithreading: Disabled
[04/20/2021-01:10:00] [I] CUDA Graph: Disabled
[04/20/2021-01:10:00] [I] Skip inference: Disabled
[04/20/2021-01:10:00] [I] Inputs:
[04/20/2021-01:10:00] [I] === Reporting Options ===
[04/20/2021-01:10:00] [I] Verbose: Enabled
[04/20/2021-01:10:00] [I] Averages: 10 inferences
[04/20/2021-01:10:00] [I] Percentile: 99
[04/20/2021-01:10:00] [I] Dump output: Disabled
[04/20/2021-01:10:00] [I] Profile: Disabled
[04/20/2021-01:10:00] [I] Export timing to JSON file:
[04/20/2021-01:10:00] [I] Export output to JSON file:
[04/20/2021-01:10:00] [I] Export profile to JSON file:
[04/20/2021-01:10:00] [I]
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Proposal version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::Split version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[04/20/2021-01:10:00] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[04/20/2021-01:10:02] [I] [TRT] ----------------------------------------------------------------
[04/20/2021-01:10:02] [I] [TRT] Input filename: /home/nano/tfobjectdetection/workspace/fp16model.onnx
[04/20/2021-01:10:02] [I] [TRT] ONNX IR version: 0.0.7
[04/20/2021-01:10:02] [I] [TRT] Opset version: 13
[04/20/2021-01:10:02] [I] [TRT] Producer name:
[04/20/2021-01:10:02] [I] [TRT] Producer version:
[04/20/2021-01:10:02] [I] [TRT] Domain:
[04/20/2021-01:10:02] [I] [TRT] Model version: 0
[04/20/2021-01:10:02] [I] [TRT] Doc string:
[04/20/2021-01:10:02] [I] [TRT] ----------------------------------------------------------------
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::Split version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[04/20/2021-01:10:02] [V] [TRT] Adding network input: input_tensor:0 with dtype: float32, dimensions: (1, 3, 640, 640)
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: input_tensor:0 for ONNX tensor: input_tensor:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Preprocessor/mul/x:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Preprocessor/sub/y:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_axes__1092
[04/20/2021-01:10:02] [W] [TRT] /home/nano/onnx-tensorrt/onnx2trt_utils.cpp:229: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_axes__534
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1274
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_empty_float__37
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv1/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv1/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/ClipToWindow/Greater/y:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_depthwise_relu/Relu6_max__220
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/expanded_conv_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/expanded_conv_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/expanded_conv_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/expanded_conv_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_1_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_2_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_3_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_4_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_5_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_6_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_7_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_8_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_9_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_10_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_11_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_12_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_13_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_expand/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_expand_BN/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_expand_BN/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_expand_BN/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_14_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_15_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_expand/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_expand/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_depthwise/depthwise_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_depthwise/depthwise_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_project/Conv2D_weights_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/block_16_project/Conv2D_bias_fused_bn
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv_1/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv_1_bn/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv_1_bn/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv_1_bn/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/functional_1/Conv_1_bn/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_3/BiasAdd/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1246
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_depthwise_conv/separable_conv2d/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_20_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1273
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_depthwise_conv/separable_conv2d/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/bottom_up_Conv2d_21_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1239
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/separable_conv2d_3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1204
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/separable_conv2d_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1212
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/separable_conv2d/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1259
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/separable_conv2d_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_4/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1304
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/separable_conv2d_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalClassHead/ClassPredictor/BiasAdd_3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1205
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1229
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1242
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/separable_conv2d_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/WeightSharedConvolutionalBoxHead/BoxPredictor/BiasAdd/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1219
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_3/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1248
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_axes__531__1184
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1216
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_2/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1267
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_2/BiasAdd/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1289
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_depthwise_conv/separable_conv2d/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_2_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1257
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_1/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1301
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/Conv2D/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/projection_1/BiasAdd/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1308
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_depthwise_conv/separable_conv2d/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/ssd_mobile_net_v2fpn_keras_feature_extractor/FeatureMaps/top_down/smoothing_1_batchnorm/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_0/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_1/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_2/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/WeightSharedConvolutionalBoxPredictor/PredictionTower/conv2d_3/BatchNorm/feature_0/FusedBatchNormV3/ReadVariableOp_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1293
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_starts__752
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_ends__753
[04/20/2021-01:10:02] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[04/20/2021-01:10:02] [V] [TRT] Weight at index 1: 9223372036854775807 is out of range. Clamping to: 2147483647
[04/20/2021-01:10:02] [V] [TRT] Weight at index 2: 9223372036854775807 is out of range. Clamping to: 2147483647
[04/20/2021-01:10:02] [W] [TRT] /home/nano/onnx-tensorrt/onnx2trt_utils.cpp:255: One or more weights outside the range of INT32 was clamped
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1188
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_axes__796
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1253
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_2_recip:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: ConstantFolding/StatefulPartitionedCall/Postprocessor/Decode/truediv_7_recip:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/sub_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/truediv_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add_1:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/truediv:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/Decode/get_center_coordinates_and_sizes/add:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1194
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1297
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/iou_threshold:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/score_threshold:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_ends__801
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/sub_18/y:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/zeros/Const:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/Reshape_3:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1255
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/mul:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/mul_1/x:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/Concatenate/concat_5/concat:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/range_1/delta:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/Select_7/e:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const__976
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: largest_int_val__1080
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/zeros:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/sub_17/x:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1269
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/sub_3/x:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/PadOrClipBoxList/zeros_6:0
[04/20/2021-01:10:02] [V] [TRT] Importing initializer: const_fold_opt__1218
[04/20/2021-01:10:02] [V] [TRT] Parsing node: StatefulPartitionedCall/Cast [Cast]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: input_tensor:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Cast [Cast] inputs: [input_tensor:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Casting to type: float32
[04/20/2021-01:10:02] [V] [TRT] Registering layer: StatefulPartitionedCall/Cast for ONNX node: StatefulPartitionedCall/Cast
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: StatefulPartitionedCall/Cast:0 for ONNX tensor: StatefulPartitionedCall/Cast:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Cast [Cast] outputs: [StatefulPartitionedCall/Cast:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: StatefulPartitionedCall/Preprocessor/mul [Mul]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Preprocessor/mul/x:0
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Cast:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/mul [Mul] inputs: [StatefulPartitionedCall/Preprocessor/mul/x:0 → ()], [StatefulPartitionedCall/Cast:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Registering constant layer: StatefulPartitionedCall/Preprocessor/mul/x:0 for ONNX initializer: StatefulPartitionedCall/Preprocessor/mul/x:0
[04/20/2021-01:10:02] [V] [TRT] Registering layer: StatefulPartitionedCall/Preprocessor/mul for ONNX node: StatefulPartitionedCall/Preprocessor/mul
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: StatefulPartitionedCall/Preprocessor/mul:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/mul:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/mul [Mul] outputs: [StatefulPartitionedCall/Preprocessor/mul:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: StatefulPartitionedCall/Preprocessor/sub [Sub]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Preprocessor/mul:0
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Preprocessor/sub/y:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/sub [Sub] inputs: [StatefulPartitionedCall/Preprocessor/mul:0 → (1, 3, 640, 640)], [StatefulPartitionedCall/Preprocessor/sub/y:0 → ()],
[04/20/2021-01:10:02] [V] [TRT] Registering constant layer: StatefulPartitionedCall/Preprocessor/sub/y:0 for ONNX initializer: StatefulPartitionedCall/Preprocessor/sub/y:0
[04/20/2021-01:10:02] [V] [TRT] Registering layer: StatefulPartitionedCall/Preprocessor/sub for ONNX node: StatefulPartitionedCall/Preprocessor/sub
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: StatefulPartitionedCall/Preprocessor/sub:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/sub:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/sub [Sub] outputs: [StatefulPartitionedCall/Preprocessor/sub:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: StatefulPartitionedCall/Preprocessor/unstack [Split]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Preprocessor/sub:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/unstack [Split] inputs: [StatefulPartitionedCall/Preprocessor/sub:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Registering layer: StatefulPartitionedCall/Preprocessor/unstack for ONNX node: StatefulPartitionedCall/Preprocessor/unstack
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: StatefulPartitionedCall/Preprocessor/unstack:0 for ONNX tensor: StatefulPartitionedCall/Preprocessor/unstack:0
[04/20/2021-01:10:02] [V] [TRT] StatefulPartitionedCall/Preprocessor/unstack [Split] outputs: [StatefulPartitionedCall/Preprocessor/unstack:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: Transpose__38 [Transpose]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: StatefulPartitionedCall/Preprocessor/unstack:0
[04/20/2021-01:10:02] [V] [TRT] Transpose__38 [Transpose] inputs: [StatefulPartitionedCall/Preprocessor/unstack:0 → (1, 3, 640, 640)],
[04/20/2021-01:10:02] [V] [TRT] Registering layer: Transpose__38 for ONNX node: Transpose__38
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: Transpose__38:0 for ONNX tensor: Transpose__38:0
[04/20/2021-01:10:02] [V] [TRT] Transpose__38 [Transpose] outputs: [Transpose__38:0 → (1, 640, 3, 640)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: Shape__41 [Shape]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: Transpose__38:0
[04/20/2021-01:10:02] [V] [TRT] Shape__41 [Shape] inputs: [Transpose__38:0 → (1, 640, 3, 640)],
[04/20/2021-01:10:02] [V] [TRT] Registering layer: Shape__41 for ONNX node: Shape__41
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: Shape__41:0 for ONNX tensor: Shape__41:0
[04/20/2021-01:10:02] [V] [TRT] Shape__41 [Shape] outputs: [Shape__41:0 → (4)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: Slice__44 [Slice]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: Shape__41:0
[04/20/2021-01:10:02] [V] [TRT] Searching for input: const_axes__1092
[04/20/2021-01:10:02] [V] [TRT] Searching for input: const_axes__534
[04/20/2021-01:10:02] [V] [TRT] Slice__44 [Slice] inputs: [Shape__41:0 → (4)], [const_axes__1092 → (1)], [const_axes__534 → (1)],
[04/20/2021-01:10:02] [V] [TRT] Registering layer: Slice__44 for ONNX node: Slice__44
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: Slice__44:0 for ONNX tensor: Slice__44:0
[04/20/2021-01:10:02] [V] [TRT] Slice__44 [Slice] outputs: [Slice__44:0 → (2)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: Concat__46 [Concat]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: Slice__44:0
[04/20/2021-01:10:02] [V] [TRT] Searching for input: const_fold_opt__1274
[04/20/2021-01:10:02] [V] [TRT] Concat__46 [Concat] inputs: [Slice__44:0 → (2)], [const_fold_opt__1274 → (2)],
[04/20/2021-01:10:02] [V] [TRT] Registering constant layer: const_fold_opt__1274 for ONNX initializer: const_fold_opt__1274
[04/20/2021-01:10:02] [V] [TRT] Registering layer: Concat__46 for ONNX node: Concat__46
[04/20/2021-01:10:02] [V] [TRT] Registering tensor: Concat__46:0 for ONNX tensor: Concat__46:0
[04/20/2021-01:10:02] [V] [TRT] Concat__46 [Concat] outputs: [Concat__46:0 → (4)],
[04/20/2021-01:10:02] [V] [TRT] Parsing node: Resize__47 [Resize]
[04/20/2021-01:10:02] [V] [TRT] Searching for input: Transpose__38:0
[04/20/2021-01:10:02] [V] [TRT] Searching for input: const_empty_float__37
[04/20/2021-01:10:02] [V] [TRT] Searching for input: const_empty_float__37
[04/20/2021-01:10:02] [V] [TRT] Searching for input: Concat__46:0
[04/20/2021-01:10:02] [V] [TRT] Resize__47 [Resize] inputs: [Transpose__38:0 → (1, 640, 3, 640)], [const_empty_float__37 → ()], [const_empty_float__37 → ()], [Concat__46:0 → (4)],
[04/20/2021-01:10:02] [V] [TRT] Registering layer: Resize__47 for ONNX node: Resize__47
[04/20/2021-01:10:02] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:703: While parsing node number 8 [Resize → “Resize__47:0”]:
[04/20/2021-01:10:02] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:704: — Begin node —
[04/20/2021-01:10:02] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:705: input: “Transpose__38:0”
input: “const_empty_float__37”
input: “const_empty_float__37”
input: “Concat__46:0”
output: “Resize__47:0”
name: “Resize__47”
op_type: “Resize”
attribute {
name: “coordinate_transformation_mode”
s: “asymmetric”
type: STRING
}
attribute {
name: “exclude_outside”
i: 0
type: INT
}
attribute {
name: “mode”
s: “linear”
type: STRING
}
attribute {
name: “nearest_mode”
s: “floor”
type: STRING
}

[04/20/2021-01:10:02] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:706: — End node —
[04/20/2021-01:10:02] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:709: ERROR: /home/nano/onnx-tensorrt/builtin_op_importers.cpp:3051 In function importResize:
[8] Assertion failed: (transformationMode == “half_pixel” || transformationMode == “pytorch_half_pixel” || transformationMode == “align_corners”) && “TensorRT only supports half_pixel, pytorch_half_pixel, and align_corners transofmration modes for linear resizes when sizes are provided!”
[04/20/2021-01:10:02] [E] Failed to parse onnx file
[04/20/2021-01:10:02] [E] Parsing model failed
[04/20/2021-01:10:02] [E] Engine creation failed
[04/20/2021-01:10:02] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/nano/tfobjectdetection/workspace/fp16model.onnx --verbose

Hi, dhiraj.patnaik1621996

Assertion failed: (transformationMode == “half_pixel” || transformationMode == “pytorch_half_pixel” || transformationMode == “align_corners”) && “TensorRT only supports half_pixel, pytorch_half_pixel, and align_corners transofmration modes for linear resizes when sizes are provided!”

The above error is caused from a non-supported operation: resize + linear interpolation + asymmetric mode.

Our internal is working on adding more interpolation support for the Resize layer.
Currently, you can update the Resize mode into nearest to skip this error.

Thanks.

Hi @AastaLLL. Thanks for getting back. One slight doubt how shall i find this exact file to make the changes?
Also i have another question about which way i should prefer to deploy models on deepstream?? tensorflow-> onnx ->engine or pytorch-> onnx → engine. I have been trying out the yolov5s too. If you have any resource for the same please share.

Thanks in advance
Regards
Dhiraj

Hi,

The update can also be done by ONNX graphsurgeon API.

For example:

import onnx_graphsurgeon as gs
import onnx
import numpy as np

graph = gs.import_onnx(onnx.load("model.onnx"))
node = [node for node in graph.nodes if node.op == "Resize"]
for n in node:
    n.attrs['mode'] = 'nearest'

onnx.save(gs.export_onnx(graph), "updated_model.onnx")

In generate, we would like to support both TensorFlow->onnx->TRT and PyTorch->onnx->TRT.
But as you know, there is some issue in the TensorFlow->onnx->TRT flow.
So if your model get stuck in the TensorFlow->onnx->TRT, you can give another path a try.

Thanks.

Hi @AastaLLL.

I will surely let you know by trying out the tf way. It wiuld be really great if i get a custom bbox parser function for yolov5s, yolov5m and yolov5l. i have tried out from here DeepStream-Yolo/YOLOv5-5.0.md at master · marcoslucianops/DeepStream-Yolo · GitHub but only difference is i converted .pt->.onnx and then to .engine but they have done .pt->.wts->engine. If you could help me out a bit for that then it would be great.
Thanks in advance. Regards
Dhiraj
I am trying out the

Hi,

Do you meet any new error after applying the ONNX graphsurgeon API mentioned in May 6?

Thanks.

Hi @AastaLLL
Yes i met a plugin error which goes like this. I tried out the fp16 model
Here is a chunk of the log::

[05/12/2021-14:58:36] [V] [TRT] Searching for input: StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/score_threshold:0
[05/12/2021-14:58:36] [V] [TRT] NonMaxSuppression__799 [NonMaxSuppression] inputs: [Unsqueeze__795:0 → (1, 51150, 4)], [Unsqueeze__797:0 → (1, 1, 51150)], [const_fold_opt__1297 → ()], [StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/iou_threshold:0 → ()], [StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/score_threshold:0 → ()],
[05/12/2021-14:58:36] [I] [TRT] No importer registered for op: NonMaxSuppression. Attempting to import as plugin.
[05/12/2021-14:58:36] [I] [TRT] Searching for plugin: NonMaxSuppression, plugin_version: 1, plugin_namespace:
[05/12/2021-14:58:36] [E] [TRT] INVALID_ARGUMENT: getPluginCreator could not find plugin NonMaxSuppression version 1
[05/12/2021-14:58:36] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:703: While parsing node number 324 [NonMaxSuppression → “NonMaxSuppression__799:0”]:
[05/12/2021-14:58:36] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:704: — Begin node —
[05/12/2021-14:58:36] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:705: input: “Unsqueeze__795:0”
input: “Unsqueeze__797:0”
input: “const_fold_opt__1297”
input: “StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/iou_threshold:0”
input: “StatefulPartitionedCall/Postprocessor/BatchMultiClassNonMaxSuppression/MultiClassNonMaxSuppression/non_max_suppression_with_scores/score_threshold:0”
output: “NonMaxSuppression__799:0”
name: “NonMaxSuppression__799”
op_type: “NonMaxSuppression”

[05/12/2021-14:58:36] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:706: — End node —
[05/12/2021-14:58:36] [E] [TRT] /home/nano/onnx-tensorrt/ModelImporter.cpp:709: ERROR: /home/nano/onnx-tensorrt/builtin_op_importers.cpp:4298 In function importFallbackPluginImporter:
[8] Assertion failed: creator && “Plugin not found, are the plugin name, version, and namespace correct?”
[05/12/2021-14:58:36] [E] Failed to parse onnx file
[05/12/2021-14:58:36] [E] Parsing model failed
[05/12/2021-14:58:36] [E] Engine creation failed
[05/12/2021-14:58:36] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=/home/nano/tfobjectdetection/workspace/updated_tfObjectDetection_fp16_model.onnx --verbose

Hi,

INVALID_ARGUMENT: getPluginCreator could not find plugin NonMaxSuppression version 1

The error is caused by a non-supported layer (NonMaxSuppression).
For the details to implement NonMaxSuppression within TensorRT, please check the below topic:

Thanks.

Hi @AastaLLL,
I’m facing the same issue.

Assertion failed: (transformationMode == "half_pixel" || transformationMode == "pytorch_half_pixel" || transformationMode == "align_corners") && "TensorRT only supports half_pixel, pytorch_half_pixel, and align_corners transofmration modes for linear resizes when sizes are provided!

When I try to run the code, the node parameter returns empty list.
I don’t know if graph nodes op names has been changed or not.

I think the code you shared is not working properly. I got the error below.

AttributeError: 'list' object has no attribute 'op'

And also, ‘mode’ key is not included in n.attrs OrderedDict.

If you have any suggestion please share.

Thanks in advance

Hi burakteke,

Please help to open a new topic if it’s still an issue. Thanks