Deepstream-test3-app use other model run multi source(ERROR)

**• Jetson orin 5.1
**• DeepStream Version6.2
**• yolov7-tiny.onnx_b1_gpu0_fp16.engina
I have the website same question " Deepstream-test3-app error - Intelligent Video Analytics / DeepStream SDK - NVIDIA Developer Forums".
about How did you generate the “yolov5s.engine” file? What is your original model? Your engine does not match the config you set in the config file. Please check your configs. I use “/usr/src/tensorrt/bin/trtexec --onnx=yolov7_640_640.onnx --minShapes=input:1x3x416x416 --optShapes=input:8x3x416x416 --maxShapes=input:8x3x416x416 --workspace=4096 --saveEngine=yolov7_640.engine --fp16”

Hi,i have successfully run the base program of"deepstream-test3-app" and use yolov5s.engine for single channel RTSP processing,but when i use multi-channel RTSP input is ERROR.Please help me,thanks.
example single: ./deepstream-test3-app ‘rtsp://admin:byzt-2018@192.168.1.108:554/cam/realmonitor?channel=1&subtype=1’
example multi(ERROR): ./deepstream-test3-app ‘rtsp://admin:123456@192.168.1.108:554/cam/realmonitor?channel=1&subtype=1’ ‘rtsp://admin:123456@192.168.1.108:554/cam/realmonitor?channel=1&subtype=1’

Using winsys: x11 
0:00:00.251669632  6746 0xaaaad4553af0 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1170> [UID = 1]: Warning, OpenCV has been deprecated. Using NMS for clustering instead of cv::groupRectangles with topK = 20 and NMS Threshold = 0.5
WARNING: [TRT]: Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even cause errors.
0:00:05.641567132  6746 0xaaaad4553af0 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1909> [UID = 1]: deserialized trt engine from :/home/y/yolov7/build-deepstream-test3-unknown-Release/yolov7-tiny.onnx_b1_gpu0_fp16.engine
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: [Implicit Engine Info]: layers num: 5
0   INPUT  kFLOAT images          3x640x640       
1   OUTPUT kINT32 num_dets        1               
2   OUTPUT kFLOAT det_boxes       100x4           
3   OUTPUT kFLOAT det_scores      100             
4   OUTPUT kINT32 det_classes     100             

0:00:05.834887103  6746 0xaaaad4553af0 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::checkBackendParams() <nvdsinfer_context_impl.cpp:1841> [UID = 1]: Backend has maxBatchSize 1 whereas 2 has been requested
0:00:05.834953669  6746 0xaaaad4553af0 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2018> [UID = 1]: deserialized backend context :/home/y/yolov7/build-deepstream-test3-unknown-Release/yolov7-tiny.onnx_b1_gpu0_fp16.engine failed to match config params, trying rebuild
0:00:05.857407328  6746 0xaaaad4553af0 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
ERROR: failed to build network since there is no model file matched.
ERROR: failed to build network.
0:00:09.026986940  6746 0xaaaad4553af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1943> [UID = 1]: build engine file failed
0:00:09.228413761  6746 0xaaaad4553af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2029> [UID = 1]: build backend context failed
0:00:09.229178593  6746 0xaaaad4553af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1266> [UID = 1]: generate backend failed, check config file settings
0:00:09.229678635  6746 0xaaaad4553af0 WARN                 nvinfer gstnvinfer.cpp:846:gst_nvinfer_start:<primary-nvinference-engine> error: Failed to create NvDsInferContext instance
0:00:09.229700717  6746 0xaaaad4553af0 WARN                 nvinfer gstnvinfer.cpp:846:gst_nvinfer_start:<primary-nvinference-engine> error: Config file path: dstest3_pgie_config.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED
Running...
ERROR from element primary-nvinference-engine: Failed to create NvDsInferContext instance
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvinfer/gstnvinfer.cpp(846): gst_nvinfer_start (): /GstPipeline:dstest3-pipeline/GstNvInfer:primary-nvinference-engine:
Config file path: dstest3_pgie_config.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED
Returned, stopping playback
Deleting pipeline
Press <RETURN> to close this window...

the applciation generated engine failed, please set model the path.

one source is ok , multi sources have this error

please make sure the model path “model-file” is set. if using two source the application will rebuild engine because there is no batch-size 2 engine.
please refer to this topic: Deepstream-test3 use myselfmodel question ERROR: failed to build network since there is no model file matched - #5 by fanzh

This discussion was also initiated by me, and the final solution through expression is still unresolved
batch-size modify 1 , but still have the same error, please help

please share your current configuration file.

[property]
gpu-id=0
net-scale-factor=0.0039215697906911373
model-color-format=0
model-engine-file=yolov7-tiny.onnx_b1_gpu0_fp16.engine
#model-engine-file=yolov7_tinytest.engine
model-file=yolov7-tiny.onnx
labelfile-path=labels.txt
force-implicit-batch-dim=1
batch-size=1
process-mode=1
model-color-format=0
network-mode=2
num-detected-classes=80
interval=0
gie-unique-id=1
parse-bbox-func-name=NvDsInferParseCustomEfficientNMS
custom-lib-path=libnvds_infercustomparser.so

[class-attrs-all]
nms-iou-threshold=0.45
pre-cluster-threshold=0.25
topk=300

[tracker]
enable=0
tracker-width=640
tracker-height=384
ll-lib-file=/opt/nvidia/deepstream/deepstream-6.1/lib/libnvds_nvmultiobjecttracker.so
gpu-id=0
enable-batch-process=1
enable-past-frame=1
display-tracking-id=1
ll-config-file=/opt/nvidia/deepstream/deepstream-6.1/samples/configs/deepstream-app/config_tracker_IOU.yml

please use “onnx-file=yolov7-tiny.onnx”.
and this error “failed to build network since there is no model file matched” is in nvinfer plugin, which is opensource, you might add logs to debug.

“onnx-file=yolov7-tiny.onnx”.
I’ve tested it, but I can’t

[property]
gpu-id=0
net-scale-factor=0.0039215697906911373
model-color-format=0
#model-engine-file=yolov7-tiny.onnx_b1_gpu0_fp16.engine
#model-engine-file=yolov7_tinytest.engine
onnx-file=yolov7-tiny.onnx
labelfile-path=labels.txt
force-implicit-batch-dim=1
batch-size=1
process-mode=1
model-color-format=0
network-mode=2
num-detected-classes=80
interval=0
gie-unique-id=1
parse-bbox-func-name=NvDsInferParseCustomEfficientNMS
custom-lib-path=libnvds_infercustomparser.so

[class-attrs-all]
nms-iou-threshold=0.45
pre-cluster-threshold=0.25
topk=300

[tracker]
enable=0
tracker-width=640
tracker-height=384
ll-lib-file=/opt/nvidia/deepstream/deepstream-6.1/lib/libnvds_nvmultiobjecttracker.so
gpu-id=0
enable-batch-process=1
enable-past-frame=1
display-tracking-id=1
ll-config-file=/opt/nvidia/deepstream/deepstream-6.1/samples/configs/deepstream-app/config_tracker_IOU.yml

please remove “force-implicit-batch-dim=1”

It’s no use deleting this remove “force-implicit-batch-dim=1”

please share the new logs, and please comment out model-engine-file, then try one source ./deepstream-test3-app ‘rtsp://admin:123456@192.168.1.108:554/cam/realmonitor?channel=1&subtype=1’

  1. please share this log.

  2. from the last screenshot, the application is still using the engine trtexec created, please comment out model-engine-file, it will let deepstream create a batch-size 1 engine, then try one source ./deepstream-test3-app ‘rtsp://admin:123456@192.168.1.108:554/cam/realmonitor?channel=1&subtype=1’, then share the terminal logs.

15:10:06.755 "../deepstream-test3/deepstream_test3_app.cpp" 652 argc 2
15:10:06.755 "../deepstream-test3/deepstream_test3_app.cpp" 659 3
15:10:06.892 "../deepstream-test3/deepstream_test3_app.cpp" 765 streammux batch-size 1
15:10:06.893 "../deepstream-test3/deepstream_test3_app.cpp" 779 pgie_batch_size 1
WARN !! Hardware mode deprecated. Prefer GPU mode instead
Unknown key 'display-tracking-id' for group [tracker]Now playing: rtsp://admin:hk123456@192.168.1.71/h264/ch1/main/av_stream,

Using winsys: x11 
0:00:00.244557024  6109 0xaaaad1281a00 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1170> [UID = 1]: Warning, OpenCV has been deprecated. Using NMS for clustering instead of cv::groupRectangles with topK = 20 and NMS Threshold = 0.5
0:00:00.245950343  6109 0xaaaad1281a00 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:367: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
..........................................................................................
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_120 || Conv_122.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_5 + PWN(LeakyRelu_6).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_7 || Conv_9.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_11 + PWN(LeakyRelu_12).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_13 + PWN(LeakyRelu_14).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_16 + PWN(LeakyRelu_17).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_19 || Conv_21.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_23 + PWN(LeakyRelu_24).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_25 + PWN(LeakyRelu_26).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_25 + PWN(LeakyRelu_26).bias] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_28 + PWN(LeakyRelu_29).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_31 || Conv_33.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_35 + PWN(LeakyRelu_36).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_37 + PWN(LeakyRelu_38).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_40 + PWN(LeakyRelu_41).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_43 || Conv_45.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_47 + PWN(LeakyRelu_48).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_49 + PWN(LeakyRelu_50).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_52 + PWN(LeakyRelu_53).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_52 + PWN(LeakyRelu_53).bias] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_54 || Conv_56.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_62 + PWN(LeakyRelu_63).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_65 + PWN(LeakyRelu_66).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_67 + PWN(LeakyRelu_68).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_71 + PWN(LeakyRelu_72).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_74 || Conv_76.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_78 + PWN(LeakyRelu_79).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_80 + PWN(LeakyRelu_81).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_83 + PWN(LeakyRelu_84).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_85 + PWN(LeakyRelu_86).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_89 + PWN(LeakyRelu_90).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_92 || Conv_94.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_96 + PWN(LeakyRelu_97).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_98 + PWN(LeakyRelu_99).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_101 + PWN(LeakyRelu_102).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_103 + PWN(LeakyRelu_104).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_106 || Conv_108.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_110 + PWN(LeakyRelu_111).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_112 + PWN(LeakyRelu_113).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_115 + PWN(LeakyRelu_116).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_117 + PWN(LeakyRelu_118).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_120 || Conv_122.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_124 + PWN(LeakyRelu_125).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_126 + PWN(LeakyRelu_127).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_129 + PWN(LeakyRelu_130).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_131 + PWN(LeakyRelu_132).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_133 + PWN(LeakyRelu_134).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_135 + PWN(LeakyRelu_136).weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_137.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_152.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: Weights [name=Conv_167.weight] had the following issues when converted to FP16:
WARNING: [TRT]:  - Subnormal FP16 values detected. 
WARNING: [TRT]: If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
0:16:15.760851591  6109 0xaaaad1281a00 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1955> [UID = 1]: serialize cuda engine to file: /home/y/yolov7/build-deepstream-test3-unknown-Release/yolov7-tiny.onnx_b1_gpu0_fp16.engine successfully
WARNING: [TRT]: The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1.
INFO: [Implicit Engine Info]: layers num: 5
0   INPUT  kFLOAT images          3x640x640       
1   OUTPUT kINT32 num_dets        1               
2   OUTPUT kFLOAT det_boxes       100x4           
3   OUTPUT kFLOAT det_scores      100             
4   OUTPUT kINT32 det_classes     100             

0:16:16.015666988  6109 0xaaaad1281a00 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:dstest3_pgie_config.txt sucessfully
Decodebin child added: source
Running...
Decodebin child added: decodebin0
Decodebin child added: rtph264depay0
Decodebin child added: h264parse0
Decodebin child added: capsfilter0
Decodebin child added: nvv4l2decoder0
Opening in BLOCKING MODE 
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
In cb_newpad
ERROR from element nvvideo-renderer: Output window was closed
Error details: /dvs/git/dirty/git-master_linux/3rdparty/gst/gst-nveglglessink/ext/eglgles/gsteglglessink.c(910): gst_eglglessink_event_thread (): /GstPipeline:dstest3-pipeline/GstEglGlesSink:nvvideo-renderer
Returned, stopping playback
Deleting pipeline
Press <RETURN> to close this window...

I deleted this model and changed the source to two, but there is still such an error

WARNING: Overriding infer-config batch-size (1) with number of sources (2)
WARN !! Hardware mode deprecated. Prefer GPU mode instead
Unknown key 'display-tracking-id' for group [tracker]Now playing: rtsp://admin:hk123456@192.168.1.71/h264/ch1/main/av_stream, rtsp://admin:hk123456@192.168.1.71/h264/ch1/main/av_stream,

Using winsys: x11 
0:00:00.285891959  6799 0xaaaad0a17af0 WARN                 nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1170> [UID = 1]: Warning, OpenCV has been deprecated. Using NMS for clustering instead of cv::groupRectangles with topK = 20 and NMS Threshold = 0.5
0:00:00.287298707  6799 0xaaaad0a17af0 INFO                 nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1923> [UID = 1]: Trying to create engine from model files
WARNING: [TRT]: onnx2trt_utils.cpp:367: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
WARNING: [TRT]: DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
ERROR: [TRT]: 4: [shapeCompiler.cpp::evaluateShapeChecks::911] Error Code 4: Internal Error (kOPT values for profile 0 violate shape constraints: reshape would change volume. IShuffleLayer Reshape_138: reshaping failed for tensor: onnx::Reshape_259)
ERROR: Build engine failed from config file
ERROR: failed to build trt engine.
0:00:06.104831205  6799 0xaaaad0a17af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1943> [UID = 1]: build engine file failed
0:00:06.299769941  6799 0xaaaad0a17af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2029> [UID = 1]: build backend context failed
0:00:06.299835893  6799 0xaaaad0a17af0 ERROR                nvinfer gstnvinfer.cpp:640:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Error in NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1266> [UID = 1]: generate backend failed, check config file settings
0:00:06.300316852  6799 0xaaaad0a17af0 WARN                 nvinfer gstnvinfer.cpp:846:gst_nvinfer_start:<primary-nvinference-engine> error: Failed to create NvDsInferContext instance
0:00:06.300339795  6799 0xaaaad0a17af0 WARN                 nvinfer gstnvinfer.cpp:846:gst_nvinfer_start:<primary-nvinference-engine> error: Config file path: dstest3_pgie_config.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED
Running...
ERROR from element primary-nvinference-engine: Failed to create NvDsInferContext instance
Error details: /dvs/git/dirty/git-master_linux/deepstream/sdk/src/gst-plugins/gst-nvinfer/gstnvinfer.cpp(846): gst_nvinfer_start (): /GstPipeline:dstest3-pipeline/GstNvInfer:primary-nvinference-engine:
Config file path: dstest3_pgie_config.txt, NvDsInfer Error: NVDSINFER_CONFIG_FAILED
Returned, stopping playback
Deleting pipeline
Press <RETURN> to close this window...

noticing trtexec uses yolov7_640_640.onnx, deepstream uses yolov7-tiny.onnx, are they the same model?

please delete the engine, not the model.
can you share the model? you might send by private email on forum.

yolov7-tiny.onnx (23.8 MB)

there is an error when converting with trtexec, here is the command:
usr/src/tensorrt/bin/trtexec --fp16 --onnx=yolov7-tiny.onnx --saveEngine=yolov7_640.engine --minShapes=images:1x3x640x640 --optShapes=images:8x3x640x640 --maxShapes=images:8x3x640x640 --workspace=4096
here is the error log:
[04/20/2023-15:02:26] [I] Finish parsing network model
[04/20/2023-15:02:26] [E] Static model does not take explicit shapes since the shape of inference tensors will be determined by the model itself
[04/20/2023-15:02:26] [E] Network And Config setup failed
[04/20/2023-15:02:26] [E] Building engine failed
[04/20/2023-15:02:26] [E] Failed to create engine from model or file.
[04/20/2023-15:02:26] [E] Engine set up failed
here is the whole log:
log.txt (6.4 KB)

only use onnx-file = yolov7-tiny.onnx can run, why