TensorRT model hardware software binding problem

[wz980947686]

Is the Tensorrt model binding with the hardware environment? For example, can the Engine generate on T4 also use on 2080Ti? Is the Tensorrt model binding with the software environment? Only can infer on the same software env where the engine generated ?

[spolisetty]

Hi,

The following may help you.

TensorRT support for multiple GPUs - URGENT

Hi, Serialized engines are not portable across platforms or TensorRT versions. Engines are specific to the exact GPU model they were built on (in addition to the platforms and the TensorRT version). It is recommended to build the serialized engines on the targeted platforms directly. Please refer to the below link for the same. Thank you.

Thank you.