Cannot load serialized engine on Jetson Xavier in c++

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier
1

Jetpack Version: 5.1.1-b56

using this command on jetson from the /usr/src/tensorrt/bin

./trtexec --loadEngine=path/saved_model_serialized/saved_model.pb

I get this error:

Serialization (Serialization assertion magicTagRead == kMAGIC_TAG failed.Magic tag does not match)
[08/09/2023-06:34:17] [E] Error[1]: [stdArchiveReader.cpp::StdArchiveReader::32] Error Code 1: Serialization (Serialization assertion magicTagRead == kMAGIC_TAG failed.Magic tag does not match)
[08/09/2023-06:34:17] [E] Error[4]: [runtime.cpp::deserializeCudaEngine::65] Error Code 4: Internal Error (Engine deserialization failed.)

The saved_model.pb was created by a python (attached) script on the same Jetson. Using python, I was able to create this serialized model and also load and infer. I am now trying to re-create the same inference using c++. The sample program fails to load the serialized model.
jetson_bug.zip (24.4 MB)

4

is it possible to get help with this issue?

6

Dear @ddrell,
loadEngine accepts only TRT model. Please pass the serailized TRT model instead of .pb file for verification.

8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.