I really liked the lite api in version 4.0, Engine class was easy to initialize and perform inference on. Now that the lite api has been removed (apparently moved to top-level tensorrt module) I was wondering if there is a way to perform inference in a similar way to trt.lite.Engine(…).infer(data)?
NVES
2
Hello,
We currently don’t have a replacement for the tensorrt.lite API. We do think the new API is designed to be more concise. Please give it a try and always appreciate community feedback.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| how to use `tensorrt.infer` for TensorRT-5.0.2.6 | 3 | 786 | November 23, 2018 | |
| Want example about performing action recognition with tensorrt | 4 | 743 | April 8, 2021 | |
| TensorRT deployment with engine generated from TLT example | 8 | 907 | December 5, 2020 | |
| Convert a Caffe model to TensorRT 5.0 | 6 | 2856 | November 1, 2019 | |
| Difference between running the inference with trtexec and tensorrt python API | 3 | 3213 | May 27, 2021 | |
| trt engine inference in python without deepstream | 8 | 1559 | October 4, 2020 | |
| TensorRT Inference form a .etlt model on Python | 6 | 1383 | October 28, 2021 | |
| TensorRT Debuging [Python API engine lite] | 0 | 489 | March 7, 2018 | |
| Run a TLT pruned model on Tensorrt | 3 | 769 | December 6, 2019 | |
| Is there C++ API of TensorRT.Lite? | 2 | 528 | May 2, 2018 |