Need help creating custom NMSPlugin.cpp

[AakankshaS]

Hi @rms45

@rms45

ASSERT(numPriors * numLocClasses * nbBoxCoordinates == inputDims[param.inputOrder[0]].d[0]);

This error states that there might be a mismatch between the training data and the deployment dimensions
However you may find help from this relevant post.

Order size is not matching the number dimensions of TensorRT

Hello, I have solved this. I want to send my code to you, but I don’t know how to attach it. So sorry. The solutions are, 1. You should specify the output name as a valid name which is in the graph, not MarkOutput0. 2. If you want to use batch dimension, you should add a 'transpose' layer after relu, which transpose the data format from 'NHWC' to 'NCHW'. And register the transpose layer as the output. BUG_CONV_PAD_Modified.7z (799 KB)

Thanks!