My prediction is segmentation result with size(976x208), when transport result to cpu, it could lost 60ms in xavier. My tensorrt version is 5.0.2.6, is there some way to solve this problem? Thank you very much.
kayccc
2
Hi mengzhibin321,
Please try with highest performance setting to see if get improved.
sudo nvpmodel -m 0
sudo jetson_clocks
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Transfer rate from GPU to CPU with pytorch on Xavier NX | 1 | 777 | February 14, 2022 | |
| Extremely slow inference in TensorRT for live semantic segmentation model | 10 | 4592 | April 12, 2022 | |
| Multi tensorrt task issue | 2 | 425 | October 9, 2020 | |
| Deal the output cost more time when use the tensorRT, and why? | 1 | 393 | March 31, 2022 | |
| TRT inference speed on two AGX Xavier | 1 | 369 | September 12, 2021 | |
| How to speed up model tensorrt conversion on Xavier | 3 | 796 | September 14, 2022 | |
| TF-TRT is too slow on Jetson AGX Xavier | 7 | 2208 | November 5, 2020 | |
| De | 1 | 378 | December 23, 2021 | |
| Jetson AGX Xavier shows unstable inference time | 5 | 832 | September 8, 2020 | |
| Onnx -> TensorRT. No speed difference between models | 1 | 582 | June 24, 2021 |