大数据 - 随笔分类 - 会飞の鱼

spark 安装

摘要：https://www.cnblogs.com/qingyunzong/p/8888080.html [root@mhc-linux sbin]# cat ../conf/spark-env.sh#!/usr/bin/env bashexport JAVA_HOME=/language/jdk1.8 阅读全文

posted @ 2019-04-02 16:20 会飞の鱼阅读(154) 评论(0) 推荐(0)

fair scheduler配置

摘要：<property> <name>yarn.resourcemanager.scheduler.class</name> <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value> 阅读全文

posted @ 2019-02-21 16:33 会飞の鱼阅读(660) 评论(0) 推荐(0)

ambari安装

摘要：Confirm Hosts阶段 /etc/hosts前两行必须是 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4::1 localhost localhost.localdomain local 阅读全文

posted @ 2019-02-21 13:42 会飞の鱼阅读(615) 评论(0) 推荐(0)

hbase安装

摘要：wget https://mirrors.tuna.tsinghua.edu.cn/apache/hbase/2.1.2/hbase-2.1.2-bin.tar.gz conf/hbase-env.sh中加入 export JAVA_HOME=/language/jdk1.8.0_181export 阅读全文

posted @ 2019-01-18 11:37 会飞の鱼阅读(142) 评论(0) 推荐(0)

hive 安装centos7

摘要：wget mirror.bit.edu.cn/apache/hive/hive-2.3.4/apache-hive-2.3.4-bin.tar.gz 解压到/usr/local/apache-hive 增加环境变量export HIVE_HOME=/usr/local/apache-hive 将bi 阅读全文

posted @ 2019-01-14 15:14 会飞の鱼阅读(199) 评论(0) 推荐(0)

hadoop2.7.7 测试安装 centos7

摘要：useradd –m hadoop –s /bin/bash passwd hadoop 增加sudo权限 chmod u+w /etc/sudoers vi /etc/sudoers root ALL=(ALL) ALL hadoop ALL=(ALL) ALL chmod u-w /etc/su 阅读全文

posted @ 2019-01-14 12:53 会飞の鱼阅读(767) 评论(0) 推荐(0)

windows上使用metastore client java api链接hive metastore问题

摘要：https://github.com/sdravida/hadoop2.6_Win_x64 下载winutils.exe 添加到path中阅读全文

posted @ 2018-12-29 14:22 会飞の鱼阅读(779) 评论(0) 推荐(0)

随笔分类 - 大数据