Accessing Invalid Address/Memory Allocation

We’re currently working on a way to pipe GPU acceleration with OpenCV within the Unity editor. That said after we play the scene once(which is almost always successful) it proceeds to crash on next playthrough spitting out this crash log below. Before that though due to this forum only allowing me to post 3 links in a single post, I was required to put in unique symbols to break the links. For example this line OpenCVForUnity.DnnModule.Ne(t):dnn_Net_delete (intptr) is just .Net at the end. Same with this line, OpenCVForUnity.DnnModule.Ne(t):Dispose (bool)

========== OUTPUTTING STACK TRACE ==================

0x00007FFD062780BB (nvcuda64) cuEventDestroy_v2
ERROR: SymGetSymFromAddr64, GetLastError: ‘Attempt to access invalid address.’ (Address: 00007FFCD8363F7A)
0x00007FFCD8363F7A (cublas64_11) (function-name not available)
ERROR: SymGetSymFromAddr64, GetLastError: ‘Attempt to access invalid address.’ (Address: 00007FFCD83615F0)
0x00007FFCD83615F0 (cublas64_11) (function-name not available)
ERROR: SymGetSymFromAddr64, GetLastError: ‘Attempt to access invalid address.’ (Address: 00007FFCD8371E0D)
0x00007FFCD8371E0D (cublas64_11) (function-name not available)
ERROR: SymGetSymFromAddr64, GetLastError: ‘Attempt to access invalid address.’ (Address: 00007FFCD83738C4)
0x00007FFCD83738C4 (cublas64_11) (function-name not available)
0x00007FFCD83AB1D7 (cublas64_11) cublasDestroy_v2
0x00007FFCDFD5E906 (opencv_dnn450) std::_Ref_count_obj2cv::dnn::cuda4dnn::csl::cublas::UniqueHandle::_Destroy
0x00007FFCDFD5939E (opencv_dnn450) cv::dnn::cuda4dnn::csl::CSLContext::~CSLContext
0x00007FFCDFD5CE20 (opencv_dnn450) std::default_deletecv::dnn::dnn4_v20200908::Net::Impl::CudaInfo_t::operator()
0x00007FFCDFD59773 (opencv_dnn450) cv::dnn::dnn4_v20200908::Net::Impl::~Impl
0x00007FFCDFD5E837 (opencv_dnn450) std::Ref_countcv::dnn::dnn4_v20200908::Net::Impl::Destroy
0x00007FFCDFD5A006 (opencv_dnn450) cv::dnn::dnn4_v20200908::Net::~Net
0x00007FFD21E441F3 (opencvforunity) dnn_Net_delete
0x000002D8B4AB8867 (Mono JIT Code) (wrapper managed-to-native) OpenCVForUnity.DnnModule.Ne(t):dnn_Net_delete (intptr)
0x000002D8B4AB85F3 (Mono JIT Code) [F:\Mixed Reality Research\Projects\OpenCVTestWithGPU\Assets\OpenCVForUnity\org\opencv\dnn\Net.cs:38] OpenCVForUnity.DnnModule.Ne(t):Dispose (bool)
0x000002D8B49AF3F1 (Mono JIT Code) [F:\Mixed Reality Research\Projects\OpenCVTestWithGPU\Assets\OpenCVForUnity\org\opencv\DisposableObject.cs:46] OpenCVForUnity.DisposableObject:Finalize ()
0x000002D8B4AFB46C (Mono JIT Code) (wrapper runtime-invoke) object:runtime_invoke_virtual_void__this
(object,intptr,intptr,intptr)
0x00007FFCE1D14659 (mono-2.0-bdwgc) [c:\build\output\unity-technologies\mono\mono\metadata\gc.c:369] mono_gc_run_finalize
0x00007FFCE1D132DE (mono-2.0-bdwgc) [c:\build\output\unity-technologies\mono\mono\metadata\gc.c:863] finalize_domain_objects
0x00007FFCE1D13545 (mono-2.0-bdwgc) [c:\build\output\unity-technologies\mono\mono\metadata\gc.c:959] finalizer_thread
0x00007FFCE1CD67F8 (mono-2.0-bdwgc) [c:\build\output\unity-technologies\mono\mono\metadata\threads.c:1043] start_wrapper_internal
0x00007FFCE1CD6586 (mono-2.0-bdwgc) [c:\build\output\unity-technologies\mono\mono\metadata\threads.c:1102] start_wrapper
0x00007FFD86FE7034 (KERNEL32) BaseThreadInitThunk
0x00007FFD879E2651 (ntdll) RtlUserThreadStart

========== END OF STACKTRACE ===========

It seems to not be able to access the cublas64_11 library. Before the crash it also spits out a memory warning about Device memory deallocation failed to deleter:

Begin MonoManager ReloadAssembly
[ WARN:1] global D:\OpenCV_CUDA\opencv-4.5.0\opencv-4.5.0\modules\dnn\src\cuda4dnn\csl\memory.hpp (67) cv::dnn::cuda4dnn::csl::ManagedPtr::{ctor}::<lambda_4a9759f1a54b59665b63625f5f218b50>::operator () Device memory deallocation failed in deleter.
OpenCV(4.5.0) D:\OpenCV_CUDA\opencv-4.5.0\opencv-4.5.0\modules\dnn\src\cuda4dnn\csl\memory.hpp:61: error: (-217:Gpu API call) invalid argument in function ‘cv::dnn::cuda4dnn::csl::ManagedPtr::{ctor}::<lambda_4a9759f1a54b59665b63625f5f218b50>::operator ()’
Exception will be ignored.

Stacktrace:

at <0xffffffff>
at (wrapper managed-to-native) OpenCVForUnity.DnnModule.Net.dnn_Net_delete (intptr) [0x00009] in <6a0ec73a7d804df087882f7bb48c3f2f>:0
at OpenCVForUnity.DnnModule.Net.Dispose (bool) [0x00028] in F:\Mixed Reality Research\Projects\OpenCVTestWithGPU\Assets\OpenCVForUnity\org\opencv\dnn\Net.cs:38
at OpenCVForUnity.DisposableObject.Finalize () [0x00002] in F:\Mixed Reality Research\Projects\OpenCVTestWithGPU\Assets\OpenCVForUnity\org\opencv\DisposableObject.cs:46
at (wrapper runtime-invoke) object.runtime_invoke_virtual_void__this__ (object,intptr,intptr,intptr) [0x0001f] in :0

Any help here would be greatly appreciated.