hadoop入门学习整理
- 技术性网站
- 1、http://dongxicheng.org/
- 2、http://www.iteblog.com/
- 3、http://www.cnblogs.com/shishanyuan/p/4147580.html
1、自动编译hadoop源码:http://abloz.com/2013/10/17/compile-hadoop-2-2-0.html http://www.aboutyun.com/thread-8130-1-1.html
2、安装protocbuf
解压下载的zip包,cd到protobuf的目录下,执行以下指令:
./configure
make
make check
make install
./configure --prefix=/usr/local/protoc
查看版本:protoc --version
遇到问题:
1、protoc: error while loading shared libraries: libprotoc.so.8: cannot open shared
错误原因:
protobuf的默认安装路径是/usr/local/lib,而/usr/local/lib 不在Ubuntu体系默认的 LD_LIBRARY_PATH 里,所以就找不到该lib
解决方法:
1. 创建文件 /etc/ld.so.conf.d/libprotobuf.conf 包含内容:
- /usr/local/lib
2. 输入命令
sudo ldconfig
2、 Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (make) on project hadoop-common: An Ant BuildException has occured: Execute failed: java.io.IOException: Cannot run program "cmake" (in directory "
sudo apt-get install cmake
3、Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (make) on project hadoop-common: An Ant BuildException has occured: exec returned: 1
4、
Unable to load native-hadoop library for your platform... using builtin-java classes where applicable