When I converting an onnx model to trt model with DLA support, I got the following warning.
Could you give me some advice?
LeakyRelu_2: ActivationLayer (with ActivationType = LEAKY_RELU) not supported for DLA.
Default DLA is enabled but layer LeakyRelu_2 is not supported on DLA, falling back to GPU.
Only 2 spatial dimension operations are supported.
Both FP16 and INT8 are supported.
Functions supported: ReLU, Sigmoid, TanH, Clipped ReLU and Leaky ReLU.
Negative slope is not supported for ReLU.
Clipped ReLU only supports values in the range [1, 127].
TanH, Sigmoid INT8 support is supported by auto-upgrading to FP16.
So I think Leaky ReLU should be supported by DLA.
But why I got an unsupport warning.
LeakyRelu_2: ActivationLayer (with ActivationType = LEAKY_RELU) not supported for DLA.
Default DLA is enabled but layer LeakyRelu_2 is not supported on DLA, falling back to GPU.
Upgrading to TensorRT 8.0 EA also may not help you. In future we may support, Please refer following link,
If we check above doc activation layers section, Its mentioned that Negative slope is not supported for ReLU for DLA hardware.
As it is unsupported operation, execution is falling back to GPU, there may be performance loss because of this. If you’re concerned about performance, try training the network with ReLU instead of LeakyReLU.
Regarding upgrading the TensorRT Version, may be you need to wait for Jetpack update.
we recommend you to post your concern on Jetson Xavier forum to get better help. Jetson AGX Xavier - NVIDIA Developer Forums