Hi @jack_calla ,
I might not be his forum talks about issues related to Tensorrt,
However maybe this thread can help
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Which one is more suitable for my needs? A100 or 4090? | 12 | 42985 | January 29, 2024 | |
| Why 4090 training slower than P100 even writing same piece of code? | 2 | 2581 | February 20, 2025 | |
| A100 vs. V100 for ML Training | 1 | 27599 | March 24, 2021 | |
| RTX3090 vs A100 | 2 | 1175 | April 4, 2023 | |
| A4000 Training Benchmark | 1 | 929 | July 4, 2023 | |
| TensorRT model accuracy on different GPUs | 3 | 2025 | October 3, 2018 | |
| Tesla K80 + RTX 4090 combined to train models and RAG | 2 | 565 | August 3, 2024 | |
| GU H100/L40S Performance | 4 | 1113 | November 25, 2024 | |
| A10 GPU using more GPU RAM than T4 GPU for inference using PyTorch TensorRT model | 0 | 1206 | December 2, 2021 | |
| Which nVidia GPU will work faster? | 0 | 69 | July 28, 2024 |