GPUassert: an illegal memory access was encountered src/modules/NvDCF/NvDCF.cpp

I am getting runtime error while running Deepstream 5 python app having the yoloV3 custom class model with NvDCF tracker.

ERROR:

GPUassert: an illegal memory access was encountered src/modules/NvDCF/NvDCF.cpp 3461
[ERROR] 2020-07-06 13:17:41 CUDA error [ERROR] 2020-07-06 13:17:41 Error destroying cuda device: VPI_STATUS_INTERNAL
(../inc/nvcudautils) Error ResourceError: e: an illegal memory access was encountered (cudaErrorIllegalAddress) (propagating from /home/rlima/src/vpi/ext/nvcudautils/src/AllocMem.cpp, function freeMem(), line 283)
(../inc/nvcudautils) Error ResourceError:  (propagating from /home/rlima/src/vpi/ext/nvcudautils/inc/nvcudautils/detail/../AllocMem.h, function operator()(), line 45)
(../inc/nvcudautils) Error ResourceError: e: an illegal memory access was encountered (cudaErrorIllegalAddress) (propagating from /home/rlima/src/vpi/ext/nvcudautils/src/AllocMem.cpp, function freeMem(), line 283)
(../inc/nvcudautils) Error ResourceError:  (propagating from /home/rlima/src/vpi/ext/nvcudautils/inc/nvcudautils/detail/../AllocMem.h, function operator()(), line 60)
(../inc/nvcudautils) Error ResourceError: e: an illegal memory access was encountered (cudaErrorIllegalAddress) (propagating from /home/rlima/src/vpi/ext/nvcudautils/src/AllocMem.cpp, function freeMem(), line 283)
(../inc/nvcudautils) Error ResourceError:  (propagating from /home/rlima/src/vpi/ext/nvcudautils/inc/nvcudautils/detail/../AllocMem.h, function operator()(), line 60)
Segmentation fault (core dumped)

pipeline consists:

  • Multiple RTSP source
  • NvDCF tracker
  • RTSP sink
  • streammux, nvvideoconvetor, tiler memory type - pyds.NVBUF_MEM_CUDA_UNIFIED

• Hardware Platform - Tesla T4
• DeepStream Version - 5.0
• NVIDIA GPU Driver Version - 440.100

There is no update from you for a period, assuming this is not an issue any more.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

Hi @mukul.kr99
is it possible to share the repo?

Thanks!