We have released a sample which demonstrates converting a Pytorch model into ONNX layers, transforming ONNX graphs using new ONNX-graphsurgeon API, implement plugins and execute using TensorRT. We hope this will be useful to accelerate your models with TensorRT. If you have any questions, let us know in comments.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Import pytorch model in TensorRT and add custom plugin layer | 7 | 5354 | May 13, 2019 | |
onnx2trt - Depthwise Cross Correlation | 4 | 1804 | July 12, 2020 | |
Convert ONNX model to TRT with custom layers | 1 | 1609 | December 24, 2020 | |
[TensorRT] ERROR: Network must have at least one output [TensorRT] ERROR: Network validation failed | 10 | 2836 | October 16, 2020 | |
Deploying Deep Neural Networks with NVIDIA TensorRT | 17 | 731 | October 8, 2017 | |
Onnx to tensorrt plugin for NonMaxSuppression | 1 | 2553 | April 26, 2020 | |
TensorFlow-Yolov3 to ONNX to trt engine | 5 | 1497 | March 26, 2021 | |
Is it possible to save and load networkdefinition in different device? | 4 | 400 | March 27, 2020 | |
Help converting a pytorch model to TensorRT | 6 | 2985 | October 18, 2021 | |
Onnx to TensorRT, with NVIDIA plugins (gridAnchor) | 11 | 2166 | November 16, 2021 |