cdh4 install for Centos6
那个最美的年代,最好的时光,一路梦想,一路流泪,流的不会是懦弱的泪,而是对奋斗的寄于;
1,repo配置
>>>/etc/yum.repo/wget http://archive.cloudera.com/cdh4/redhat/6/x86_64/cdh/cloudera-cdh4.repo
或是wget archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.x86_64.rpm
yum --nogpgcheck localinstall cloudera-cdh-4.x86_64.rpm
2,添加Repository key for Centos6
rpm --import http://archive.cloud.com/cdh4/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
3,yum 安装cdh相关daemons在相关master,slaves上命令,此时未考虑HA;
默认MRv1,MRv2(YARN)未考虑
where to install install commands
JobTracker:
yum -y install hadoop-0.20-mapreduce-jobtracker;
NameNode:
yum -y install hadoop-hdfs-namenode
SecondaryNameNode:
yum -y install hadoop-hdfs-secondarynamenode
DataNode,TaskTracker:
yum -y install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode
Client hosts:
yum -y install hadoop-client
MRv1版本yum部署
yum.repos.d]# yum -y install hadoop-0.20-mapreduce-jobtracker hadoop-hdfs-namenode hadoop-hdfs-secondarynamenode hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode hadoop-client
MRv2 即 YARN:
Resource Manguager(analogous MRv1 JobTracker):
yum -y install hadoop-yarn-resourcemanager
yum -y install hadoop-hdfs-namenode
yum -y install yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
yum -y install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver
MRv2(YARN)与MRv1 yum Install区别
Resource Manager host
yum -y install hadoop-yarn-resourcemanager
NameNode host
yum -y install hadoop-hdfs-namenode
SecondaryName host
yum -y install hadoop-hdfs-secondarynode
All cluster host except Resource Manager
yum -y install hadoop-yarn-nodemanager hadoop-hdfs-datanode hadoop-mapreduce
one host in the cluster
yum -y install hadoop-mapreduce-historyserver hadoop-yarn-proxyserver
可选项:
1,LZO(压缩算法,具体见google)
wget http://archive.cloudera.com/gplextras/redhat/6/x86_64/gplextras/cloudera-gplextras4.repo 到/etc/yum.repo/
yum -y install hadoop-lzo-cdh4
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 开发者必知的日志记录最佳实践
· SQL Server 2025 AI相关能力初探
· Linux系列:如何用 C#调用 C方法造成内存泄露
· AI与.NET技术实操系列(二):开始使用ML.NET
· 记一次.NET内存居高不下排查解决与启示
· 开源Multi-agent AI智能体框架aevatar.ai,欢迎大家贡献代码
· Manus重磅发布:全球首款通用AI代理技术深度解析与实战指南
· 被坑几百块钱后,我竟然真的恢复了删除的微信聊天记录!
· 没有Manus邀请码?试试免邀请码的MGX或者开源的OpenManus吧
· 园子的第一款AI主题卫衣上架——"HELLO! HOW CAN I ASSIST YOU TODAY