Deepstream-Yolo doesn't use DLA

wei.zhang12 · May 13, 2024, 3:43am

Please provide complete information as applicable to your setup.

• Hardware Platform Jetson
**• DeepStream Version 6.3 **
• JetPack Version 5.1.2
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

When I use Deepstream-Yolo to integrate with deepstream infer plugin.
And I tried to turn on DLA for infer. And I tested with deepstream-test1, after I monitor the Jtop, I can find the DLA is used.

But if I run with Yolo model, the DLA will not be used. Is this expected? Or I missed something elase?

fanzh · May 13, 2024, 5:19am

please make sure enable-dla and use-dla-core are set. please find these parameters in this link for the explanation.

wei.zhang12 · May 13, 2024, 5:23am

I have configured those 2 properties. And I verified with deepstream-test1, it works. And I only replace with yolo model, and then it doesn’t work.
Below is my configuration

fanzh · May 13, 2024, 5:35am

could you share the whole log of deepstream-test1? Thanks! especially the the log of generating TRT engine for yolo?

wei.zhang12 · May 13, 2024, 5:56am

I just using deepstream-test1 to verify DLA can work with it.

For my own app which uses Yolo model, it’s logs as below.
If I need recreate engine, and log detail trace, please let me know which log level you need.

0:00:04.541806907 243261 0xaaab1ba52460 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1988> [UID = 1]: deserialized trt engine from :/opt/etas/perception/model_b1_gpu0_fp16.engine
0:00:04.715100270 243261 0xaaab1ba52460 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2091> [UID = 1]: Use deserialized engine model: /opt/etas/perception/model_b1_gpu0_fp16.engine
0:00:04.809096144 243261 0xaaab1ba52460 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:/opt/etas/perception/pgie_config_b1_fp16.yaml sucessfully

fanzh · May 13, 2024, 6:29am

the log you shared is about loading engine. In dla model, the engine should include dla, for example, deepstream_tao_apps/models/yolov4/yolov4_resnet18_epoch_080.onnx_b1_dla0_int8.engine successfully.
please share the log of creating TRT engine.

wei.zhang12 · May 17, 2024, 3:59am

Hi Fanzh,

Below is the log when I use DLA to generate TRT engine file. There are a lot of warning about “Unsupported on DLA”.

So the problem is, how can I let my ONNX file is valid for DLA?
I export ONNX following by below guide.
https://github.com/marcoslucianops/DeepStream-Yolo/blob/master/docs/YOLOv8.md

python3 utils/export_yoloV8.py -w yolov8s.pt --dynamic

WARNING: [TRT]: onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
WARNING: [TRT]: Tensor DataType is determined at build time for tensors not marked as input or output.

Building the TensorRT Engine

WARNING: [TRT]: DLA requests all profiles have same min, max, and opt value. All dla layers are falling back to GPU
WARNING: [TRT]: Layer ‘/0/model.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 9) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 10) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 11) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 12) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 13) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 15) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 16) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 17) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/Split_3’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/m.0/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.2/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.3/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.3/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.3/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 36) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 37) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 38) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 39) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 40) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 42) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 43) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 44) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/Split_8’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.0/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/m.1/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.4/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.5/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.5/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.5/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 70) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 71) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 72) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 73) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 74) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 76) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 77) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 78) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/Split_13’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.0/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/m.1/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.6/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.7/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.7/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.7/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 104) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 105) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 106) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 107) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 108) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 110) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 111) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 112) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/Split_18’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/m.0/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.8/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/m/MaxPool’ (POOLING): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/m_1/MaxPool’ (POOLING): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/m_2/MaxPool’ (POOLING): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.9/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.10/Resize’ (RESIZE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.11/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 140) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 141) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 142) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 143) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 144) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 146) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 147) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 148) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/Split_22’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.12/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.13/Resize’ (RESIZE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.14/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 165) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 166) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 167) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 168) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 169) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 171) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 172) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 173) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/Split_26’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.15/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.16/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.16/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.16/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.17/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 192) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 193) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 194) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 195) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 196) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 198) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 199) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 200) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/Split_30’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.18/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.19/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.19/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.19/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.20/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 219) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 220) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 221) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 222) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 223) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 225) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 226) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 227) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/Split_34’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/m.0/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv2/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv2/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.21/cv2/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.0/cv2.0.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.0/cv3.0.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.1/cv2.1.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.1/cv3.1.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_1’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv2.2/cv2.2.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.0/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.0/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.0/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.1/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.1/act/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.1/act/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/cv3.2/cv3.2.2/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_2’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_1_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_2_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_3’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_3_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_4_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_4’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_5_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_6_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_5’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_6’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_7_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Split_46’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Split_47’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_1’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_12_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_1’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_2’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_13_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_2’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_14_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_15_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 319) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 320) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 321) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 322) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 323) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 324) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 325) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 327) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_16_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 329) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_1’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_17_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_18_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 334) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 335) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 336) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 337) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 338) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 339) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 340) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_1’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 342) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_19_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 344) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_1’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_4’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_3’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_4’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_7’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_22_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_8’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_5’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 354) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 355) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 356) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 357) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 358) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 359) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_23_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_9’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_6’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 364) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 365) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 366) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 367) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 368) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 369) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_4’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_10’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_7’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_5’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_27_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_11’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 379) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 380) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 382) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 383) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_2’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_5’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_28_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_3’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_6’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_29_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_4’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_2’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_30_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_31_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 394) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 395) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 396) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 397) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 398) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 399) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 400) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_2’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 402) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_32_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 404) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_3’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_3’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_33_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_34_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 409) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 410) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 411) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 412) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 413) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 414) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 415) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_3’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 417) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_35_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 419) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_4’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_8’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_9’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_7’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_8’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_12’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_38_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_13’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_10’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 429) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 430) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 431) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 432) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 433) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 434) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_2’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_39_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_14’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_11’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 439) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 440) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 441) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 442) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 443) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 444) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_3’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_6’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_7’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_15’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_12’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul_1’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_8’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_43_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_16’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 454) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 455) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 457) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 458) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_5’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_9’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_44_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_5’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_10’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_45_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_6’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_4’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_46_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_47_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 469) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 470) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 471) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 472) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 473) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 474) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 475) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_4’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 477) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_48_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 479) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_6’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_5’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_49_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_50_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 484) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 485) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 486) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 487) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 488) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 489) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 490) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_5’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 492) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_51_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 494) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_7’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_13’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_14’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_11’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_12’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_17’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_54_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_18’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_15’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 504) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 505) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 506) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 507) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 508) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 509) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_4’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_55_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_19’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_16’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 514) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 515) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 516) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 517) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 518) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 519) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_5’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_9’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_10’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_20’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_17’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul_2’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_11’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_59_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_21’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 529) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 530) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape_2’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 532) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 533) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_8’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_22’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_23’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Transpose’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Transpose_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 539) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 540) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 541) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 542) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 543) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Split_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 545) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 546) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 547) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Split_1_112’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Shape’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Gather’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Shape_1’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_1_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Gather_1’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_2_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_3_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Reshape’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Transpose’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Softmax’ (SOFTMAX): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 563) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 564) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/conv/Conv’ (CONVOLUTION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_4_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Concat_1’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Reshape_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_12’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_13’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_61_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_7’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_63_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_9’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_64_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Div’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_65_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul_3’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 581) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 582) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 583) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 584) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 585) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 586) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 587) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 588) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 589) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 590) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 591) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 592) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 593) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 594) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 595) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 596) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 597) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 598) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 599) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 600) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 601) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 602) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 603) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Slice’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_66_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul_4’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 607) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 608) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 609) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 610) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 611) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 612) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 613) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 614) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 615) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 616) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 617) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 618) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 619) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 620) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 621) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 622) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 623) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 624) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 625) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 626) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 627) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 628) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 629) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 630) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 631) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 632) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 633) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 634) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Slice_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Sub’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_10’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Add_11’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_67_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 640) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Div_1’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Sub_1’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_24’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 644) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Mul_5’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Sigmoid’ (ACTIVATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_25’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/1/Transpose’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 649) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 650) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 651) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 652) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 653) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 654) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 655) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 656) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 657) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 658) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 659) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 660) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 661) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 662) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 663) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 664) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 665) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 666) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 667) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 668) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 669) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 670) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 671) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 672) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.

fanzh · May 17, 2024, 5:16am

the log is incomplete because I did not see the engine was created. In my last comment, the engine was created and the name includes “dla0”. “Unsupported on DLA” only means some layers does not support DLA, not all layers does not support.

wei.zhang12 · May 17, 2024, 5:48am

Currently, I can generate dla engine file, and the pipeline is running.
But it seems there is nothing can be detected. Form OSD, there is no objects are detected. It’s wired.

0:00:03.052874070 351726 0xaaaad264c870 WARN nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1976> [UID = 1]: deserialize engine from file :/opt/etas/perception/model_b1_dla1_fp16.engine failed
0:00:03.221302121 351726 0xaaaad264c870 WARN nvinfer gstnvinfer.cpp:679:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2081> [UID = 1]: deserialize backend context from engine from file :/opt/etas/perception/model_b1_dla1_fp16.engine failed, try rebuild
0:00:03.221424587 351726 0xaaaad264c870 INFO nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2002> [UID = 1]: Trying to create engine from model files
load configyml
find paramKey:source-list
find camera url :file:///opt/etas/perception/gtt_720p_25f.mp4
simulation enabled :0
find paramKey:streammux
find paramKey:osd
find paramKey:tiler
find paramKey:sink
find paramKey:primary-gie
find paramKey:tracker
find paramKey:msgconv
find paramKey:msgbroker
there are 0 simulartion cars
Now playing : file:///opt/etas/perception/gtt_720p_25f.mp4
Using file: config.yaml
Decodebin child added: nvurisrc_bin_src_elem
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
WARNING: Deserialize engine failed because file path: /opt/etas/perception/model_b1_dla1_fp16.engine open error
WARNING: [TRT]: onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
WARNING: [TRT]: onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
WARNING: [TRT]: Tensor DataType is determined at build time for tensors not marked as input or output.

Building the TensorRT Engine

WARNING: [TRT]: Layer ‘(Unnamed Layer* 9) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 10) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 11) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 11) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 12) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 13) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 15) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 16) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 16) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 17) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 36) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 37) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 38) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 38) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 39) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 40) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 42) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 43) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 43) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 44) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 70) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 71) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 72) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 72) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 73) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 74) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 76) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 77) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 77) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 78) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 104) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 105) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 106) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 106) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 107) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 108) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 110) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 111) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 111) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 112) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 140) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 141) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 142) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 142) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 143) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 144) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 146) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 147) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 147) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 148) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 165) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 166) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 167) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 167) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 168) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 169) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 171) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 172) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 172) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 173) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 192) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 193) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 194) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 194) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 195) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 196) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 198) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 199) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 199) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 200) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 219) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 220) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 221) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 221) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 222) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 223) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 225) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 226) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 226) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 227) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_1_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_2_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_3: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_3’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_3_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_4_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_4: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_4’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_5_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_6_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_5: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_5’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_6: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_6’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_7_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Split: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Split’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Split_46: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Split_46’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Split_47: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Split_47’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Squeeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_1’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_12_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_1’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_2’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_13_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_2’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_14_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_15_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 320) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 320) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 321) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 322) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 325) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 327) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_16_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 329) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_1’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_17_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_18_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 335) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 335) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 336) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 337) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 340) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_1’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 342) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_19_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 344) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_4’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_3’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_4’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_7: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_7’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_22_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_8: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_8’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_5’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 354) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 356) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_23_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_9: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_9’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_6’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 364) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 366) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand_1: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_4’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_10: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_10’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_7’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_5’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_27_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_11: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_11’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 379) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 380) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/ConstantOfShape: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 382) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 383) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_5’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_28_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_3’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_6’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_29_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_4’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_2’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_30_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_31_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 395) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 395) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 396) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 397) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 400) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_2’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 402) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_32_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 404) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_3’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_33_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_34_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 410) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 410) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 411) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 412) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 415) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_3’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 417) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_35_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 419) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_8’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_9’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_7’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_8’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_12: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_12’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_38_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_13: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_13’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_10’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 429) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 431) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand_2: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_2’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_39_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_14: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_14’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_11’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 439) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 441) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand_3: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_3’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_6’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_7’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_15: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_15’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_12’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_8’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_43_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_16: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_16’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 454) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 455) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/ConstantOfShape_1: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 457) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 458) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_9’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_44_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_5’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_10’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_45_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_6’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_4’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_46_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_47_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 470) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 470) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 471) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 472) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 475) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_4’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 477) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_48_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 479) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Cast_5’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_49_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_50_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 485) [ElementWise]: DLA cores do not support FLOOR_DIV ElementWise operation.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 485) [ElementWise]’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 486) [Identity]’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 487) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 490) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Range_5’ (FILL): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 492) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_51_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 494) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_13’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_14’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_11’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_12’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_17: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_17’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_54_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_18: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_18’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_15’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 504) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 506) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand_4: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_4’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_55_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_19: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_19’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_16’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 514) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 516) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Expand_5: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Expand_5’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_9’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_10’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_20: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_20’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Reshape_17’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_11’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_59_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_21: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_21’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 529) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 530) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/ConstantOfShape_2: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/ConstantOfShape_2’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 532) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 533) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_22: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_22’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_23: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_23’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Transpose’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Transpose_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 539) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 540) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 541) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 541) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 542) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 543) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Split_1: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Split_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 545) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 546) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 546) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 547) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Split_1_112: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Split_1_112’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Shape’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Gather’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Shape_1’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_1_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Gather_1’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_1’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_2_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_3_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/dfl/Concat: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Concat’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Reshape’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 564) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_2’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Unsqueeze_3’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Constant_4_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/dfl/Concat_1: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/dfl/Concat_1’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Unsqueeze_12’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Shape_13’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_61_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Gather_7’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_63_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_64_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Div: DLA cores do not support DIV ElementWise operation.
WARNING: [TRT]: Layer ‘/0/model.22/Div’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_65_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 581) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 582) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 582) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 583) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 584) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 585) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 587) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 589) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 592) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 594) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 598) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 602) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Slice: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Slice’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_66_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 607) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 608) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 608) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 609) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 610) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 611) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 612) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 612) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 613) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 614) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 616) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 620) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 623) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 625) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 629) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 633) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Slice_1: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/0/model.22/Slice_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/0/model.22/Constant_67_output_0’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 640) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Div_1: DLA cores do not support DIV ElementWise operation.
WARNING: [TRT]: Layer ‘/0/model.22/Div_1’ (ELEMENTWISE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_24: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_24’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 644) [Shuffle]’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /0/model.22/Concat_25: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘/0/model.22/Concat_25’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/1/Transpose’ (SHUFFLE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 649) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 650) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 651) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 651) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 652) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 653) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 654) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 656) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 658) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 661) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 663) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 667) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 671) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /1/Slice: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/1/Slice’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 674) [Shape]’ (SHAPE): DLA only supports FP16 and Int8 precision type. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 675) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: (Unnamed Layer* 676) [Concatenation]: DLA only supports concatenation on the C dimension.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 676) [Concatenation]’ (CONCATENATION): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 677) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 678) [Gather]’ (GATHER): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 679) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 681) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 683) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 686) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 688) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 692) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘(Unnamed Layer* 696) [Constant]’ (CONSTANT): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: /1/Slice_1: DLA only supports slicing 4 dimensional tensors.
WARNING: [TRT]: Layer ‘/1/Slice_1’ (SLICE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/1/ReduceMax’ (REDUCE): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/1/ArgMax’ (TOPK): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: Layer ‘/1/Cast’ (CAST): Unsupported on DLA. Switching this layer’s device type to GPU.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape. Switching to GPU fallback.
WARNING: [TRT]: Splitting DLA subgraph at: /0/model.22/Reshape because DLA validation failed for this layer.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape. Switching to GPU fallback.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape_1. Switching to GPU fallback.
WARNING: [TRT]: Splitting DLA subgraph at: /0/model.22/Reshape_1 because DLA validation failed for this layer.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape_1. Switching to GPU fallback.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape_2. Switching to GPU fallback.
WARNING: [TRT]: Splitting DLA subgraph at: /0/model.22/Reshape_2 because DLA validation failed for this layer.
WARNING: [TRT]: DLA only supports shuffle with 4-D input and output
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Reshape_2. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_1. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, but input shapes were: [80] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_1. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, but input shapes were: [80] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_4. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, but input shapes were: [40] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_4. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_3. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, bu t input shapes were: [40] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_3. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_7. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, bu t input shapes were: [20] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_7. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_6. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, bu t input shapes were: [20] and [1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_6. Switching to GPU fallback.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/dfl/Softmax. Switch ing to GPU fallback.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/dfl/conv/Conv. Swit ching to GPU fallback.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/dfl/Reshape_1. Swit ching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_2. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: Batch size (6400) exceeds maximum allowed size for DLA: 4096
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_2. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_5. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, bu t input shapes were: [1600,1] and [1,1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_5. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_8. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: DLA only allows inputs of the same dimensions to Elementwise, bu t input shapes were: [400,1] and [1,1]
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_8. Switching to GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Sub. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Sub. Switching to G PU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_10. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_10. Switching t o GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Add_11. At least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Add_11. Switching t o GPU fallback.
WARNING: [TRT]: Input tensor has less than 4 dimensions for /0/model.22/Sub_1. A t least one shuffle layer will be inserted which cannot run on DLA.
WARNING: [TRT]: Dimension: 3 (8400) exceeds maximum allowed size for DLA: 8192
WARNING: [TRT]: Validation failed for DLA layer: /0/model.22/Sub_1. Switching to GPU fallback.
0:02:04.411917973 351726 0xaaaad264c870 INFO nvinfer gstnvinfer. cpp:682:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:2034> [UID = 1]: serialize cuda engine to file: /opt/etas/perception/model_b1_dla1_fp1 6.engine successfully
0:02:04.674153029 351726 0xaaaad264c870 INFO nvinfer gstnvinfer_ impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load ne w model:/opt/etas/perception/pgie_config_b1_fp16.yaml sucessfully

(v2x:351726): GLib-GObject-WARNING **: 13:41:36.095: g_object_set_is_valid_prope rty: object class ‘GstFileSrc’ has no property named ‘drop-on-latency’
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261

fanzh · May 17, 2024, 5:58am

the engine with “dla1” was generated. if you monitor the Jtop, is DLA used?

wei.zhang12 · May 17, 2024, 6:01am

Yes the DLA is used, but the object detection seems not working. I can only find 1 object detection during 1 mins. But when I was using gup model, I can detect a lot object for each frame.

fanzh · May 19, 2024, 3:20pm

could you use deepstream-test1 to reproduce this issue? Thanks! wondering if it is related to the model.

wei.zhang12 · May 20, 2024, 5:17am

Hi fanzh,

I can cofirm deepstream-test1 with model resnet10.caffemodel is working well for both GUP and DLA.
But my yolov8n.onnx is working well for GPU but not working for DLA.

fanzh · May 20, 2024, 3:03pm

I can’t reproduce this issue on Orin with DS7.0. Here is the screenshot. could you share the whole log and screenshot?

wei.zhang12 · May 20, 2024, 11:50pm

Hi fanzh,

I tried to provide you all of my logs and configuration to reproduce this issue.

You can put below config files under deepstream-test1-app to reproduce my issue.
dstest1_config.yml
labels.txt
pgie_config_b1_fp16.yaml
yolov8n.onnx
lib

And I also do a screenshot about the object detection, from there you can find just few of frames I can detect few vehicles.

The gst_1.log contains the log information for engine file generation.
The gst_2.log is generated when I do the screenshot, at that moment, the engine file has been generated.

dla_problem.zip (17.4 MB)

fanzh · May 21, 2024, 3:24am

Using the same model and configuration files, I still can’t reproduce this issue on Orin with DS7.0. Here is the log, log-0521.txt (105.5 KB). the log printed "Frame Number = 0 Number of objects = 6 ", which means many objected are detected.
to narrow down this issue, could you do the following checking?

is the so generated from this code nvdsinfer_custom_impl_Yolo, did you modify the code?
please set pre-cluster-threshold: 0 and nms-iou-threshold: 0, then run again. wondering if the bbox accuracy is low.
please use this method to generate a new engine, then set the new path to model-engine-file, for example, model-engine-file: new_model_b1_dla0_fp16.engine, then run again to check. wondering it is related to the generating engine by DeepStream.

wei.zhang12 · May 21, 2024, 4:07am

Yes I generate so from source code, I don’t change anything. When I run under gpu model. Evenything works well.

After I set pre-cluster-threshold: 0 and nms-iou-threshold:0, I can get a lot of detected objects.

About engine regeneration, I relay on deepstream to generate engine (before this I delete those old engine file). If I shall use the TensorRT cmmond line, I am not so familar with this. Can you provide some more detail commnd line to convert engine file?

BTW, I find if I run under DLA, it seems there is very large latency from output.

fanzh · May 21, 2024, 5:06am

are the detected objects correct? if yes, you can set a low pre-cluster-threshold and nms-iou-threshold for a workaround.
the trtexec cmd is /usr/src/tensorrt/bin/trtexec --onnx=yolov8n.onnx --saveEngine=new_model_b1_dla0_fp16.engine --minShapes=input:1x3x640x640 --optShapes=input:2x3x640x640 --maxShapes=input:4x3x640x640 --useDLACore=0 --allowGPUFallback
about “it seems there is very large latency from output.”, could you open a new topic to focus on this new issue?

fanzh · May 28, 2024, 7:52am

Sorry for the late reply, Is this still an DeepStream issue to support? Thanks!
about improving DLA accuracy, please refer to this sample cuDLA-samples.

yingliu · June 25, 2024, 2:53am

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

Topic		Replies	Views
The inference for adding yolov5 in the deepstream example sends an error when yolov5 turns engine Metropolis Microservices for Jetson	24	460	June 7, 2024
Failed to convert YOLOv7.onnx model to DLA engine Jetson AGX Xavier tensorrt , nvbugs , dla	6	1733	May 31, 2023
Missing dynamic range for tensor output_bbox/BiasAdd. DLA requires all tensors dynamic range to be known DeepStream SDK	7	824	November 16, 2021
Unable to use DLA cores in nvinfer DeepStream SDK	9	880	October 12, 2021
Issues with running UFFSSD on DLA with Jetson Xavier Jetson AGX Xavier tensorrt , nvbugs , dla	18	1245	October 18, 2021
Conver tf1 model to onnx, inference in tensorrt error Jetson Xavier NX tensorrt , tensorflow , jetson-inference , python	4	1222	October 10, 2021
Fail to convert .uff to .engine File when DLA is Enabled(Out of Memory) DeepStream SDK dla	9	530	October 12, 2021
Transfer Learning Toolkit DLA warning messages TAO Toolkit dla	9	1589	July 1, 2022
using DLA but not accelerate Jetson AGX Xavier	2	1492	October 18, 2021
Xavier NX does not support adaptative average pooling on DLA? Jetson Xavier NX tensorrt	27	1134	October 11, 2023

Deepstream-Yolo doesn't use DLA

Related topics