Originally published at: https://developer.nvidia.com/tensorrt-getting-started#new_tab
Today NVIDIA released TensorRT 8.4, which includes new tools to explore TensorRT optimized engines and quantize the TensorFlow models with QAT.
jwitsoe
1
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Just Released: TensorRT 8.4 | 0 | 296 | June 16, 2022 | |
| How am I able to make TensorRT work and quantize the AI model to FP4? | 4 | 85 | September 1, 2025 | |
| NVIDIA TensorRT 10.0 Upgrades Usability, Performance, and AI Model Support | 1 | 238 | May 14, 2024 | |
| Accelerate Generative AI Inference Performance with NVIDIA TensorRT Model Optimizer, Now Publicly Available | 4 | 346 | July 16, 2024 | |
| NVIDIA TensorRT Model Optimizer v0.15 Boosts Inference Performance and Expands Model Support | 1 | 62 | August 15, 2024 | |
| NVIDIA TensorRT Model Optimizer로 생성형 AI 추론 성능 가속화 | 1 | 235 | May 17, 2024 | |
| Optimizing Inference on Large Language Models with NVIDIA TensorRT-LLM, Now Publicly Available | 8 | 1931 | January 25, 2024 | |
| 업그레이드된 NVIDIA TensorRT 10.0의 사용성, 성능, AI 모델 지원 | 1 | 180 | May 29, 2024 | |
| TensorRT 8.0: What’s New | 2 | 1181 | July 20, 2021 | |
| TensorRT 5 GA Now Available | 0 | 284 | August 21, 2022 |