How to convert TensortFlow to TensorRT with two ouputs

AakankshaS · September 15, 2020, 10:37am

Hi @Denny.hsu

The below links may help you resolving the issue.

github.com/NVIDIA/TensorRT

../rtSafe/cuda/genericReformat.cu (1262) - Cuda Error in executeMemcpy: 11

opened 07:17AM - 09 Mar 20 UTC

closed 02:41AM - 10 Mar 20 UTC

oyrq

API: C++

## Description I use dynamic shape input for onnx model in tensorRT, but I ha…ve a problem when run executeV2() bool status = mPreprocessorContext->executeV2(preprocessorBindings.data()); error: [E] [TRT] ../rtSafe/cuda/genericReformat.cu (1262) - Cuda Error in executeMemcpy: 11 (invalid argument) [E] [TRT] FAILED_EXECUTION: std::exception [E] [TRT] engine.cpp (182) - Cuda Error in ~ExecutionContext: 77 (an illegal memory access was encountered) [E] [TRT] INTERNAL_ERROR: std::exception [E] [TRT] Parameter check failed at: ../rtSafe/safeContext.cpp::terminateCommonContext::165, condition: cudaEventDestroy(context.start) failure. [E] [TRT] Parameter check failed at: ../rtSafe/safeContext.cpp::terminateCommonContext::170, condition: cudaEventDestroy(context.stop) failure. [E] [TRT] ../rtSafe/safeRuntime.cpp (32) - Cuda Error in free: 77 (an illegal memory access was encountered) terminate called after throwing an instance of 'nvinfer1::CudaError' Thanks! ## Environment **TensorRT Version**: 7.0.0.11 C++ API **GPU Type**: 2080 **Nvidia Driver Version**: 418.56 **CUDA Version**: 10.0 **CUDNN Version**: 7.6.5.32 **Operating System + Version**: ubuntu 16.04

Thanks!