Originally published at: Upgrade to the newest versions of NVIDIA CUDA-X libraries | NVIDIA Technical Blog
Learn what’s new in the latest releases of cuDNN, CUDA, TensorRT, DALI, and Nsight Compute. cuDNN 7.5 The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. This version of cuDNN includes: Multi-head attention for accelerating popular models such as TransformerImproved depth-wise separable convolution for training models…