TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	5	5335	November 6, 2023
Best practices for reporting an issue or bug relating to TensorRT	0	8442	September 21, 2018
Bug : Tensorrt Model not loading on same GPU on a different device (slight driver version difference) tensorrt , cudnn	0	24	April 26, 2024
What is "Interactivity per User Tokens per Second" mentioned in Jensen's GTC 2024 talk	3	185	April 26, 2024
Unsupported SM: 0x601 cudnn	2	139	April 25, 2024
Implicitly data-dependent shape and explicitly data-dependent shape	0	37	April 25, 2024
Pip Installation Error with pytorch-quantization	9	2809	April 25, 2024
Latest TensorRT release tensorrt	4	341	April 23, 2024
This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: FMA, i tensorrt , tensorflow , cudnn	0	100	April 22, 2024
Post processing logic for TensorRT Peoplenet in Python tensorrt , cuda	10	449	April 22, 2024
deserializeCudaEngine failed. Serialization assertion magicTagRead == kMAGIC_TAG failed.Magic tag does not match	4	1988	April 22, 2024
Jetpack 6 \| tensorflow model \| Object detection \| inference \| Jetson orin nano module cudnn	0	62	April 21, 2024
PyTorch usage of INMSLayer on TensorRT pytorch	2	360	April 19, 2024
The engine plan file is generated on an incompatible device expecting compute 6.1 got compute 8.6,please rebuild	3	1321	April 19, 2024
Convert onnx to engine failed by using trtexec, stack overflow; cudnn	0	67	April 19, 2024
TensorRT --- non-int8 fallback when trying to calibrate ONNX model tensorrt , deepstream	0	110	April 17, 2024
TensorRT engine cannot be safely deleted in deconstruction of a global or static instance tensorrt	4	459	April 18, 2024
Error reading serialized TensorRT engine tensorrt , cuda , ubuntu , cudnn , computer-vision	1	100	April 18, 2024
TensorRT V10 inference using context.execute_async_v3()	1	104	April 17, 2024
How to correctly set up bindings for execute_async_v3()? tensorrt	1	94	April 17, 2024
TRT FIle	0	94	April 16, 2024
Arduino Nano (USB) -- Jetson Xavier NX kernel , usb , arduino	0	74	April 16, 2024
How to run a neural network on DLA only in Jetson devices? tensorrt , dla	0	73	April 16, 2024
Unable to claim the course certificate deep-learning	3	102	April 15, 2024
Issue with TensorRT Whisper consuming inordinate amount of system memory which kills the process tensorrt , cuda , pytorch , cudnn	0	85	April 15, 2024
Onnx to tensorrt problem	1	105	April 15, 2024
Tensorrt Threads affect each other during multithreaded inference tensorrt	15	968	April 15, 2024
Fundamentals of Deep Learning - Accidentally clicked on 'assess task'	2	123	April 12, 2024
Something wrong the rstp stream deepstream analysis cudnn , deepstream	2	119	April 11, 2024
Troubles install torch2trt pytorch , cudnn , jetson	3	168	April 11, 2024

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…