TensorRT Inference Server on Windows

ondrejm · April 9, 2019, 8:19am

Hi,

Is it possible to run (install) TensorRT inference Server on Windows?

Thank you.

NVES · April 9, 2019, 3:29pm

Topic		Replies	Views
TensorRT on Windows GPU-Accelerated Libraries	1	2984	March 2, 2018
Windows support TensorRT inference engine GPU-Accelerated Libraries	1	1493	March 5, 2018
communicate with TensorRT inference engine server within windows 10 system TensorRT	0	398	September 6, 2019
NVIDIA TensorRT Inference Server Available Now Technical Blog	0	271	August 21, 2022
TensorRT Inference Server Windows support TensorRT	6	1638	July 8, 2019
Real Time Inference with Multi GPU - Multiple Model Triton Inference Server - archived	1	1374	January 29, 2020
Can TensorRT run on Windows server 2016？ TensorRT	1	399	December 18, 2020
Is there any other way besides TensorRT to increase the GPU utilization while doing the inference? TensorRT	1	742	March 25, 2019
Which container shoulf be used for inference of trt files in Jetsons? Jetson Xavier NX containers	2	378	June 27, 2022
TensorRT engine and inference in existing CUDA context TensorRT tensorrt	0	440	November 17, 2020