TensorRT 8.2 and Framework Integrations are out now!

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download.

Highlight includes:

  • TensorRT 8.2
    • Optimizations for T5 and GPT-2 deliver real time translation and summarization with 21x faster performance vs CPUs
    • Simple Python API for developers using Windows
  • Framework Integrations: Torch-TensorRT and TensorFlow-TensorRT (TF-TRT) speed up inference up to 6x with one line of code

Learn more about the announcement here.

Watch these Webinar from GTC November 2021 to get yourself familiar with the latest updates:

Thanks,

TensorRT Team

6

Anything exciting in the roadmap for TensorRT? Rust/Go bindings perhaps?

7

Can you share a little more information about how you would want to use such bindings , I am not familiar with them, so was not sure how to articulate the ask.
Thanks so much.

9

There is a trend of some companies that want to develop explicitly on memory safe languages, look at Microsoft recently, they have Windows 11 components written in Rust instead of C++ for safety and security.