Please provide complete information as applicable to your setup.
• Hardware Platform: GPU
• DeepStream Version : 5
• TensorRT Version
• NVIDIA GPU Driver Version : 440.64.00
Hey , So I was able to run the deepstream-ssd-parser python app(https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/master/apps/deepstream-ssd-parser/deepstream_ssd_parser.py) on a server running gcloud,
The next thing I wanted to was use the triton server for inference in the deepstream imagedata example (https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/master/apps/deepstream-imagedata-multistream/deepstream_imagedata-multistream.py) . So I made the nescessary changes by adding the helper libraries and changing the nvinfer element to nvinferserver and parsing output using pgie_probe. For the config file I used the same one as the ssd-parser example
Wierdly the pipeline works for the first 718 frames and then exactly at the 719th frame throws this error
E tensorflow/stream_executor/cuda/cuda_event.cc:29] Error polling for event status: failed to query event: CUDA_ERROR_ILLEGAL_ADDRESS: an illegal memory access was encountered
2020-07-10 10:22:44.807278: F tensorflow/core/common_runtime/gpu/gpu_event_mgr.cc:273] Unexpected Event status: 1
Aborted (core dumped)
It seems to be something to do with cuda and tensorflow but I don’t get why the ssd-parser example was working then
What are your suggestions to combat this issue?