Further examples of the use of trtlite

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I found this nvidia repo (GitHub - NVIDIA/trt-samples-for-hackathon-cn: Simple samples for TensorRT programming) and found TRTLite c++ class particularly useful.

Would it be possible to provide an end to end example of TRTLite C++ which includes the preprocessing and postprocessing steps so that we would have greater understanding from an end-to-end perspective ? Thank you.

https://github.com/NVIDIA/trt-samples-for-hackathon-cn/blob/master/samples/AppOnnx.cpp#L68

4

Hi,

Hope the following samples may help you.

We can export TRT engine as .plan file and use also.
https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html#perform_inference_c

Thank you.