We are finding that the only way we can use TensorRT (7.2.3.4) on a new GPU that we haven’t used before, we have to rebuild TensorRT on that GPU type first. For example, our software works on RTX 2070 Max Q but didn’t work on a GTX 1050 TI. So we got hold of a 1050 TI to build TRT on that machine b…

TensorRT support for multiple GPUs - URGENT

AI & Data Science Deep Learning (Training & Inference) TensorRT

spolisetty October 28, 2021, 4:39am 6

Hi,

Serialized engines are not portable across platforms or TensorRT versions. Engines are specific to the exact GPU model they were built on (in addition to the platforms and the TensorRT version). It is recommended to build the serialized engines on the targeted platforms directly.

Please refer to the below link for the same.

Thank you.

TensorRT model hardware software binding problem

Topic		Replies	Views
How can we build a tensorRT model just once and run on different GPUs? TensorRT	3	429	May 5, 2020
tensorrt-3 portability GPU-Accelerated Libraries	1	460	November 29, 2017
TensorRT model hardware software binding problem TensorRT tensorrt , cuda	1	358	November 11, 2022
How to inference with tensorrt on multi gpus in python TensorRT	2	2195	April 9, 2021
Cross Operating System platform compatibility with the same GPU platform TensorRT tensorrt	1	456	April 11, 2022
Build TensorRT on Cuda compute capability 7.5 and make it backward compatible with previous capabilities TensorRT tensorrt	4	2031	May 19, 2022
tensorRT engine file can be used in different TX2 devices? Jetson TX2 tensorrt	3	1174	September 19, 2021
How to run TensorRT on a muliti-GPU platform. TensorRT	2	3459	October 12, 2021
TensorRT support for GeForce GPUs? TensorRT	1	2475	November 2, 2018
.engine generated on device A can`t be deployed to device B TensorRT tensorrt	3	401	May 17, 2023

TensorRT support for multiple GPUs - URGENT

Related topics