I have some models running on TX2 devices well, then I want to move to NX device. I did INT8 calibration for my models from onnx. When I load INT8 models on my NX device, I got error on assert(engine->getNbBindings() == 2). Copy a few code below.
engine = runtime->deserializeCudaEngine(modelStream, size); delete modelStream; assert(engine != nullptr); context = engine->createExecutionContext(); assert(context != nullptr); assert(engine->getNbBindings() == 2);
What may cause this kind of issues? How should I debug this issue? Is there any additional code change for new INT8 models?