470.74 Driver crash when using gl elements in gstreamer pipeline

I’m trying to run a gstreamer pipeline for receiving MPEG TS stream and saving it as an mp4. I’ve used glcolorconvert and gldownload elements in my pipeline. The pipeline runs okay most of the times but a few times it crashes with a segfault in glcontext. Can anyone tell me if this has something to do with the driver version or the card itself?

Video card: RTX A4000
Driver: 470.74

gstglcontext[12202]: segfault at 0 ip 00007f222af17ad5 sp 00007f2298649280 error 6 in libnvidia-glcore.so.470.74[7f2229f45000+1261000]

Found a similar issue while trying to play RTSP, Attaching gdb output

Starting program: /usr/local/bin/gst-launch-1.0 rtspsrc location=\"rtsp://\" retry=100 latency=1000 user-id=admin user-pw=pass23 \! watchdog timeout=300000 \! valve name=valve drop=false \! rtph264depay \! h264parse \! queue leaky=downstream \! nvdec \! fakesink
warning: Error disabling address space randomization: Operation not permitted
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Setting pipeline to PAUSED ...
[New Thread 0x7f2caa1f8700 (LWP 973)]
[New Thread 0x7f2ca99f7700 (LWP 974)]
[New Thread 0x7f2ca90f4700 (LWP 975)]
[New Thread 0x7f2ca1fff700 (LWP 976)]
[New Thread 0x7f2ca17fe700 (LWP 977)]
[New Thread 0x7f2ca0ffd700 (LWP 978)]
Pipeline is live and does not need PREROLL ...
[New Thread 0x7f2c8dfff700 (LWP 979)]
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://
[New Thread 0x7f2c8d7fe700 (LWP 980)]
[New Thread 0x7f2c8cffd700 (LWP 981)]
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Progress: (request) Sending PLAY request
[New Thread 0x7f2c81fff700 (LWP 983)]
Progress: (request) Sending PLAY request
[New Thread 0x7f2c817fe700 (LWP 984)]
[New Thread 0x7f2c80ffd700 (LWP 985)]
[New Thread 0x7f2c5bfff700 (LWP 986)]
Progress: (request) Sent PLAY request
[New Thread 0x7f2c5b7fe700 (LWP 987)]
[New Thread 0x7f2c5affd700 (LWP 988)]
[New Thread 0x7f2c5a004700 (LWP 989)]
Got context from element 'nvdec0': gst.gl.GLDisplay=context, gst.gl.GLDisplay=(GstGLDisplay)"\(GstGLDisplayX11\)\ gldisplayx11-0";
[New Thread 0x7f2c59803700 (LWP 990)]

Thread 18 "gstglcontext" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0x7f2c59803700 (LWP 990)]
0x00007f2c42d0ee7c in ?? () from /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.470.74