Hi, I tried to run the ssd example jupyter notebook with RTX gpus, I successfully trained, pruned and retrain the model, but when I want to run tlt-evaluate or tlt-infer commands I got following error in jupyter: tensorflow.python.framework.errors_impl.UnknownError: Failed to get convolution algori…

cuDNN error on tlt-evaluate ssd and tlt-infer ssd

Morganh May 3, 2020, 3:32am 2

Please try
$ export TF_FORCE_GPU_ALLOW_GROWTH=true

Topic		Replies	Views
Error with cuDNN when attempting to perform inference after training an SSD model with TLT TAO Toolkit	2	1337	November 24, 2020
TLT notebooks/detectnet_v2.ipynb: tlt-evaluate detectnet_v2 Failing TAO Toolkit	2	893	August 11, 2020
TLT fail to init a cudnn with a RTX GPU, cannot fix without source TAO Toolkit	2	451	April 29, 2020
cuDNN failed to initialize while running the evaluation method for detectnet_v2 TAO Toolkit cuda	5	739	January 11, 2021
Failed to get convolution algorithm. This is probably because cuDNN failed to initialize. PLEASE HELP cuDNN	1	2588	May 17, 2021
cuDNN failed to initialize Frameworks (archived) tensorflow	1	891	March 21, 2020
Failed to get convolution algorithm. This is probably because cuDNN failed to initialize cuDNN cuda , tensorflow , cudnn	1	924	April 9, 2021
Failed to get convolution algorithm. This is probably because cuDNN failed to initialize cuDNN	1	834	June 23, 2020
tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR cuDNN	4	7254	December 24, 2020
Fail to initialize CUDNN when running tensorflow: CUDNN_STATUS_INTERNAL_ERROR Jetson AGX Xavier tensorflow , cudnn	6	3025	August 28, 2020