The NVIDIA CUDA Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned implementations for standard routines such as forward and backward convolution, attention, matmul, pooling, and normalization.
Installation guide: https://docs.nvidia.com/deeplearning/cudnn/latest/installation/linux.html
https://developer.nvidia.com/cudnn-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=22.04&target_type=deb_local
Installation Instructions: wget https://developer.download.nvidia.com/compute/cudnn/9.4.0/local_installers/cudnn-local-repo-ubuntu2204-9.4.0_1.0-1_amd64.deb sudo dpkg -i cudnn-local-repo-ubuntu2204-9.4.0_1.0-1_amd64.deb sudo cp /var/cudnn-local-repo-ubuntu2204-9.4.0/cudnn-*-keyring.gpg /usr/share/keyrings/ sudo apt-get update sudo apt-get -y install cudnn To install for CUDA 12, perform the above configuration but install the CUDA 12 specific package: sudo apt-get -y install cudnn-cuda-12
zzh@ZZHPC:~/Downloads/cuDNN$ sudo apt-get -y install cudnn-cuda-12 Reading package lists... Done Building dependency tree... Done Reading state information... Done Note, selecting 'cudnn9-cuda-12' instead of 'cudnn-cuda-12' cudnn9-cuda-12 is already the newest version (9.4.0.58-1). cudnn9-cuda-12 set to manually installed. 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded. zzh@ZZHPC:~/Downloads/cuDNN$ sudo apt-get -y install cudnn9-cuda-12 Reading package lists... Done Building dependency tree... Done Reading state information... Done cudnn9-cuda-12 is already the newest version (9.4.0.58-1). 0 upgraded, 0 newly installed, 0 to remove and 6 not upgraded.
