Fp16 IPluginV2DynamicExt, ../builder/cudnnBuilderUtils.cpp (427) - Cuda Error in findFastestTactic: 700 (an illegal memory access was encountered)

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

When using fp16：
This error occurs when using IPluginV2DynamicExt, but everything is normal when using the plugin IPluginV2Ext.

When using fp32:
The both plugins works fine.

I found a similar problem as show in here

I want to know if there is a way to avoid this error in the IPluginV2DynamicExt.

thanks.

3

Hi,

This error may happen if the buffer or model data type is not aligned.

We have some plugin samples using the IPluginV2DynamicExt.
Could you check if you implement and declare all the buffer in a similar way first?

Thanks.

5

thanks for your reply.

I tried IPluginV2DynamicExt with dynamic model, fp16 and fp32 all works fine, but static model, fp16 occurs the error. I deliver a buffer from the host to copy the device data. Does it not support such operations.

the trt version is 7.2.2.

thanks.

6

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

Hi,

Do you run the source on XavierNX?
Since we don’t have TensorRT 7.2.2 for Jetson device yet.

Thanks.