编译hadoop
基于操作系统CentOS 6.4 basic server版,编译hadoop版本2.5.2
1. 下载hadoop源代码包
$ wget http://mirrors.cnnic.cn/apache/hadoop/common/hadoop-2.5.2/hadoop-2.5.2-src.tar.gz
2. 安装工具包
$ sudo yum install lzo-devel zlib-devel gcc autoconf automake libtool ncurses-devel openssl-deve cmake git
3. 安装maven
$ wget http://mirrors.cnnic.cn/apache/maven/maven-3/3.2.5/binaries/apache-maven-3.2.5-bin.tar.gz
export MAVEN_HOME=/home/yimr/build_hadoop/apache-maven-3.2.5
export PATH=$PATH:$MAVEN_HOME/bin
4. 安装ant
$ wget http://mirrors.cnnic.cn/apache//ant/binaries/apache-ant-1.9.4-bin.tar.gz
export ANT_HOME=/home/yimr/build_hadoop/apache-ant-1.9.4
export PATH=$PATH:$ANT_HOME/bin
5. 安装findbugs
$ wget http://prdownloads.sourceforge.net/findbugs/findbugs-noUpdateChecks-3.0.0.tar.gz?download
export FINDBUGS_HOME=/home/yimr/build_hadoop/findbugs-3.0.0
export PATH=$PATH:$FINDBUGS_HOME/bin
6. 安装protobuf(只能是版本2.5.0,不能更高版本或更低版本)
$ wget https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
$ ./configure --prefix=/home/yimr/build_hadoop/protobuf-2.5.0
$ make
$ make install
7. 编译hadoop
$ cd /home/yimr/build_hadoop/hadoop-2.5.2-src
$ mvn package -DskipTests -Pdist,native -Dtar
8. 编译成功
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 13:34 min
[INFO] Finished at: 2015-01-12T13:19:34+08:00
[INFO] Final Memory: 147M/524M
[INFO] -------------------------
9. 替换native lib
posted on 2015-01-12 13:46 SYSTEM ADMINISTRATION 阅读(166) 评论(0) 编辑 收藏 举报