in my project i create 2 threads, in the thread function,use tensor-rt to load and forward the caffemodel,but i get the “cuda failure:77” code,how to understand the error code? if i run the same code not in the thread function it’s ok.so i guess is there some reasons with the thread?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| TensorRT do_inference error | 19 | 8404 | November 14, 2022 | |
| How to do inference with two engine? | 1 | 1102 | January 20, 2020 | |
| illegal memory exception on T4 | 5 | 1078 | July 17, 2019 | |
| CUDA cask failure at execution for trt_volta_scudnn_128x64_relu_xregs_large_nn_v1 | 5 | 912 | May 12, 2022 | |
| Running 2 models on the same GPU with TensorRT | 7 | 1248 | January 15, 2021 | |
| [reformat.cpp::executeCutensor::384] Error Code 1: CuTensor (Internal cuTensor permutate execute failed) | 4 | 1953 | June 28, 2023 | |
| Tensorrt Threads affect each other during multithreaded inference | 16 | 1393 | September 6, 2024 | |
| Error in cuda when trying to inference via multiprocessing | 2 | 1692 | November 14, 2021 | |
| How to implement TensorRT as an inference server? | 2 | 1730 | October 24, 2019 | |
| Multi-threaded Object detection fails with Cudnn Error in execute: 7 | 1 | 775 | October 29, 2019 |