Hadoop 2.8 +Mysql 搭建Hive2.x.x

安装mysql (ubuntu):

sudo apt-get install mysql-server

去 https://dev.mysql.com/downloads/connector/j/ 下载mysql的java驱动放到hive的lib目录里去

如果是deb安装包的话,装完后, 一般jar文件会被放在例如/usr/share/java/mysql-connector-java-8.0.11.jar



hive配置文件 conf/hive-site.xml 

<configuration>
    <property>
        <name>hive.metastore.local</name>
        <value>true</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://127.0.0.1:3306/hive?useSSL=false</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.cj.jdbc.Driver</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>hive</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>mysql</value>
    </property>
</configuration>

1. MySQL的链接字符串要加 useSSL=false

2. hive.downloaded.resources.dir  这个配置项一定要当心, 退出hive时会清空这个目录

3. 新的jdbc驱动jdbc.driver的属性值从com.mysql.jdbc.Driver换为com.mysql.cj.jdbc.Driver.

4 &符号在XML的转义是&amp;


在Mysql中创建metastore:

从hive2.0开始要执行hive bin目录下的schematool来创建metastore(别忘了现在mysql中create database)

./schematool -dbType mysql -initSchema

环境变量:

在/etc/source确保有如下环境变量(根据实际情况调整路径):

export HADOOP_HOME=/home/rav009/hadoop-2.8.0
export PATH=$HADOOP_HOME/bin/:$PATH
export HIVE_HOME=~/hive/apache-hive-2.x.x-bin
export PATH=$HIVE_HOME/bin:$PATH


posted @ 2017-05-08 20:45  爱知菜  阅读(13)  评论(0编辑  收藏  举报