Install cuDNN

The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned implementations for standard routines such as forward and backward convolution, attention, matmul, pooling, and normalization.

 

Installation guide: https://docs.nvidia.com/deeplearning/cudnn/latest/installation/linux.html

 

https://developer.nvidia.com/cudnn-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=22.04&target_type=deb_local

 

Installation Instructions:
wget https://developer.download.nvidia.com/compute/cudnn/9.4.0/local_installers/cudnn-local-repo-ubuntu2204-9.4.0_1.0-1_amd64.deb
sudo dpkg -i cudnn-local-repo-ubuntu2204-9.4.0_1.0-1_amd64.deb
sudo cp /var/cudnn-local-repo-ubuntu2204-9.4.0/cudnn-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cudnn

To install for CUDA 12, perform the above configuration but install the CUDA 12 specific package:
sudo apt-get -y install cudnn-cuda-12

 

zzh@ZZHPC:~/Downloads/cuDNN$ sudo apt-get -y install cudnn-cuda-12
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'cudnn9-cuda-12' instead of 'cudnn-cuda-12'
cudnn9-cuda-12 is already the newest version (9.4.0.58-1).
cudnn9-cuda-12 set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.
zzh@ZZHPC:~/Downloads/cuDNN$ sudo apt-get -y install cudnn9-cuda-12
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
cudnn9-cuda-12 is already the newest version (9.4.0.58-1).
0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.