Hmm…had you recently done an apt upgrade
by chance?
If so, can you try the steps from this post?
Also, here is what my libcudnn looks like on L4T R32.6.1:
# outside of container
ls -ll /usr/lib/aarch64-linux-gnu/libcudnn.so.8*
lrwxrwxrwx 1 root root 17 May 24 2021 /usr/lib/aarch64-linux-gnu/libcudnn.so.8 -> libcudnn.so.8.2.1
-rw-r--r-- 1 root root 162280 May 24 2021 /usr/lib/aarch64-linux-gnu/libcudnn.so.8.2.1
# inside l4t-ml container
ls -ll /usr/lib/aarch64-linux-gnu/libcudnn.so.8*
lrwxrwxrwx 1 root root 17 Dec 2 17:08 /usr/lib/aarch64-linux-gnu/libcudnn.so.8 -> libcudnn.so.8.2.1
-rw-r--r-- 1 root root 162280 May 24 2021 /usr/lib/aarch64-linux-gnu/libcudnn.so.8.2.1
How does it look for you?