Inferencing Images 100x Faster with GPUs and TensorRT

Originally published at: Inferencing Images 100x Faster with GPUs and TensorRT | NVIDIA Technical Blog

At this week’s Computer Vision and Pattern Recognition conference, NVIDIA demonstrated how one Tesla V100 running NVIDIA TensorRT can perform a common inferencing task 100X faster than a system without GPUs. In the video below, the CPU-only Intel Skylake-based system (on the left) can classify five flower images per second with a Resnet-152 trained classification…