安装Horovod
1. 安装nccl2
(1)下载:https://developer.nvidia.com/nccl
(2)根据机型选择对应的安装文件:例如:nccl-repo-rhel7-2.7.8-ga-cuda10.1-1-1.x86_64.rpm
(3)安装命令:
sudo yum nccl-repo-rhel7-2.7.8-ga-cuda10.1-1-1.x86_64.rpm sudo yum install libnccl libnccl-devel libnccl-static
2.安装horovod
HOROVOD_GPU_OPERATIONS=NCCL pip install horovod