TRT incompatibility: TensorRT not supporting INT64 but PyTorch indexing forces INT64

AI & Data Science Deep Learning (Training & Inference) TensorRT

maeotaku June 6, 2019, 3:45am 1

So I have noticed that TRT does not support INT64 which is a big problem when it comes to NLU models, since most of them use indexing to get embeddings, and Pytorch forces indexing of tensors to be done using Long/INT64.

Is there any workaround or fix for this? does this mean I cannot use TensorRT for NLP/NLU?

Topic		Replies	Views
ONNX/TensorRT INT64 Clamping. Why? TensorRT	4	685	July 6, 2023
Workarounds about TensorRT INT64 datatype TensorRT tensorrt	1	1070	September 27, 2021
TensorRT Loading Onnx Model Error with LSTM/recursion/loop Frameworks tensorflow	1	783	May 31, 2020
Does TensorRT6 support pytorch 1.3 onnx model ?? TensorRT	2	913	October 12, 2021
Tensorrt Conversion TensorRT	2	73	November 30, 2024
TensorRT5.0.x INT8 for Onnx? General	2	963	October 12, 2021
Downcasting from INT64 to INT32 TensorRT	1	4630	January 30, 2020
Error on converting ONNX to FP16 TensorRT with my model Deep Learning (Training & Inference)	0	405	August 17, 2020
Converting TensorRT models to ONNX to TF/PyTorch DeepStream SDK	3	1064	October 12, 2021
Unable to convert ONNX model to TensorRT TensorRT tensorrt , pytorch , onnx	6	3473	September 30, 2020

Pytorch->ONXX->TRT incompatibility: TensorRT not supporting INT64 but PyTorch indexing forces INT64

Related topics