展开
拓展 关闭
订阅号推广码
GitHub
视频
公告栏 关闭

hive单机版安装

  • 前提
已经安装了jdk、mysql、hadoop

主机名:master
映射:192.168.128.129 master
  • 将apache-hive-2.3.9-bin.tar.gz上传到服务器
# 解压
tar -zxvf apache-hive-2.3.9-bin.tar.gz
# 移动
mv /home/apache-hive-2.3.9-bin/* /usr/local/software/hive-2.3.9

# 配置
vi /etc/profile
# 配置如下
export HIVE_HOME=/usr/local/software/hive-2.3.9
export HIVE_CONF_DIR=$HIVE_HOME/conf
export PATH=$HIVE_HOME/bin:$PATH
# 生效
source /etc/profile
  • 创建数据库,存储hive元数据
create database hive_metastore default charset=utf8;
  • 移动mysql驱动
mv mysql-connector-java-8.0.30.jar /usr/local/software/hive-2.3.9/lib
  • 配置hive-site.xml
vi /usr/local/software/hive-2.3.9/conf/hive-site.xml

<configuration>
  <property>
      <name>hive.metastore.warehouse.dir</name>
      <value>hdfs://master:9000/user/hive/warehouse</value>
  </property>
  <property>
      <name>javax.jdo.option.ConnectionURL</name>
      <value>jdbc:mysql://master:3306/hive_metastore</value>
      <description>JDBC connect string for a JDBC metastore</description>
  </property>
  <property>
      <name>javax.jdo.option.ConnectionDriverName</name>
      <value>com.mysql.cj.jdbc.Driver</value>
      <description>Driver class name for a JDBC metastore</description>
  </property>
  <property>
      <name>javax.jdo.option.ConnectionUserName</name>
      <value>root</value>
      <description>username to use against metastore database</description>
  </property>
  <property>
      <name>javax.jdo.option.ConnectionPassword</name>
      <value>123456</value>
      <description>password to use against metastore database</description>
  </property>
  <property>
      <name>hive.metastore.uris</name>
      <value>thrift://master:9083</value>
  </property>
  <property>
      <name>hive.metastore.schema.verification</name>
      <value>false</value>
  </property>
  <property>
      <name>datanucleus.schema.autoCreateAll</name>
      <value>true</value>
  </property>
  <property>
      <name>hive.server2.authentication</name>
      <value>NONE</value>
  </property>
  <property>
      <name>hive.server2.enable.doAs</name>
      <value>false</value>
  </property>
</configuration>
  • 初始化元数据库
schematool -dbType mysql -initSchema
  • 测试
# 启动mysql
mysql.server start
# 启动hadoop
start-dfs.sh
start-yarn.sh

# 启动hive元数据
[root@master conf]# hive --service metastore &
[2] 8619
2023-12-14 17:46:57: Starting Hive Metastore Server
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/software/hive-2.3.9/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/software/hadoop-2.9.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

# 启动hiveserver2
[root@master ~]# hive --service hiveserver2 &
[1] 8732
2023-12-14 17:47:37: Starting HiveServer2
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/software/hive-2.3.9/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/software/hadoop-2.9.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]

# 查看进程
[root@master ~]# jps
7794 NameNode
7925 DataNode
8839 Jps
8249 ResourceManager
8619 RunJar
8732 RunJar
8095 SecondaryNameNode

# 连接hive
[root@master ~]# beeline -u jdbc:hive2://root@master:10000
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/software/hive-2.3.9/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/software/hadoop-2.9.2/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Connecting to jdbc:hive2://root@master:10000
Connected to: Apache Hive (version 2.3.9)
Driver: Hive JDBC (version 2.3.9)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 2.3.9 by Apache Hive
0: jdbc:hive2://root@master:10000> show databases;
+----------------+
| database_name  |
+----------------+
| default        |
+----------------+
1 row selected (1.46 seconds)
posted @ 2023-12-13 21:10  DogLeftover  阅读(108)  评论(0编辑  收藏  举报