[ERROR] Model has dynamic shape but no optimization profile specified

Please provide the following information when requesting support.

• Hardware (T4/V100/Xavier/Nano/etc): Nvidia Titan RTX
• Network Type (Detectnet_v2/Faster_rcnn/Yolo_v4/LPRnet/Mask_rcnn/Classification/etc): Yolo_v4
• TLT Version (Please run “tlt info --verbose” and share “docker_tag” here): 3.0
• Training spec file(If have, please share here): NA
• How to reproduce the issue ? (This is for errors. Please share the command line and the detailed log here.):NA

I used the tlt-converter (cuda111-cudnn80-trt72) downloaded from here to convert .etlt to .engine file:

./tlt-converter -k key \
                -m 16 \
                -b 8 \
                -i nchw \
                -d 3,800,1376 \
                -o BatchedNMS \
                -c yolov4_cspdarknet19_epoch_130.bin \
                -e yolov4_cspdarknet19_epoch_130.etlt_b2_gpu0_int8.engine \
                -t int8 \
                -w 1073741824 \
                -s false \
                yolov4_cspdarknet19_epoch_130.etlt

I got the following error:

[WARNING] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[WARNING] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[INFO] ModelImporter.cpp:135: No importer registered for op: BatchedNMSDynamic_TRT. Attempting to import as plugin.
[INFO] builtin_op_importers.cpp:3771: Searching for plugin: BatchedNMSDynamic_TRT, plugin_version: 1, plugin_namespace: 
[INFO] builtin_op_importers.cpp:3788: Successfully created plugin: BatchedNMSDynamic_TRT
[INFO] Detected input dimensions from the model: (-1, 3, 800, 1376)
[ERROR] Model has dynamic shape but no optimization profile specified.
Aborted (core dumped)

Inspecting the core file didn’t provide useful clue on how to deal with this error:

Reading symbols from tlt-converter...(no debugging symbols found)...done.
[New LWP 5837]
[New LWP 5840]
[New LWP 5841]
[New LWP 5842]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `./tlt-converter -k NXA1NDFtaTZwNmsxNnZhczZuZmxpamszbTc6MTI0NGQwMjEtMjk5NC00Y2Y5'.
Program terminated with signal SIGABRT, Aborted.
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
51	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
[Current thread is 1 (Thread 0x7f9be7cfc000 (LWP 5837))]
(gdb) backtrace
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007f9bbfd38921 in __GI_abort () at abort.c:79
#2  0x000055830f0cc23a in infer_onnx_shapes(nvinfer1::INetworkDefinition*) ()
#3  0x000055830f0cf2b0 in convert(std::basic_ifstream<char, std::char_traits<char> >*, int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int, int, int, nvinfer1::DataType, bool, nvuffparser::UffInputOrder) ()
#4  0x000055830f0ce6af in main ()

Please advice.

1 Like

For your case, please add
-p Input,1x3x800x1376,8x3x800x1376,16x3x800x1376

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.