Apache DolphinScheduler单机安装步骤

1所需条件

1)mysql数据库

2)jdk 1.8以上

3) zookeeper

2,下载最新的tar.gz包

sit环境用的是这个版本:apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz

创建用户:

# add user escheduler
useradd escheduler;
 
# modify user password
echo "escheduler" | passwd --stdin escheduler
 
# 配置sudo免密
sed -i '$aescheduler  ALL=(ALL)  NOPASSWD: NOPASSWD: ALL' /etc/sudoers
 
# 修改目录权限,使得部署用户对dolphinscheduler目录有操作权限 
chown -R escheduler:escheduler dolphinscheduler
tar -zxvf apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin.tar.gz

mv apache-dolphinscheduler-incubating-1.2.1-dolphinscheduler-bin  dolphinscheduler

3,ssh免密登录

 
su escheduler;
 
ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys

4,修改数据库的链接:改成你所需要的链接

spring.datasource.driver-class-name=com.mysql.jdbc.Driver
spring.datasource.url=jdbc:mysql://xxxx:3306/dolphinscheduler?characterEncoding=utf8
spring.datasource.username=xxx
spring.datasource.password=xxxxx

5,修改java的软连接

sudo ln -s /opt/soft/java/bin/java /usr/bin/java

6,修改install.sh,单机配置参考如下

# for example postgresql or mysql ...
dbtype="mysql"
 
# db config
# db address and port
dbhost="xxxxxxxxxx:3306"
 
# db name
dbname="dolphinscheduler"
 
# db username
username="xxxx"
 
# db passwprd
# Note: if there are special characters, please use the \ transfer character to transfer
passowrd="xxxxx"
 
# conf/config/install_config.conf config
# Note: the installation path is not the same as the current path (pwd)
installPath="/data1_1T/dolphinscheduler"
 
# deployment user
# Note: the deployment user needs to have sudo privileges and permissions to operate hdfs. If hdfs is enabled, the root directory needs to be created by itself
deployUser="escheduler"
 
# zk cluster
zkQuorum="xxxx:2181"
 
# install hosts
# Note: install the scheduled hostname list. If it is pseudo-distributed, just write a pseudo-distributed hostname
ips="localhost"
 
# ssh port, default 22
# Note: if ssh port is not default, modify here
sshPort=22
# run master machine
# Note: list of hosts hostname for deploying master
masters="localhost"
 
# run worker machine
# note: list of machine hostnames for deploying workers
workers="localhost"
 
# run alert machine
# note: list of machine hostnames for deploying alert server
alertServer="localhost"
 
# run api machine
# note: list of machine hostnames for deploying api server
apiServers="localhost"

7,安装python的zookeeper工具kazoo

 
#安装pip
sudo yum -y install python-pip;  #ubuntu请使用 sudo apt-get install python-pip
sudo pip install kazoo;

8,执行部署命令

sh install.sh

9,验证是否启动

ps -ef|grep java

eschedu+  2753     1  1 15:45 ?        00:01:06 /usr/java/jdk1.8.0_144/bin/java -Dlogging.config=classpath:master_logback.xml -Ddruid.mysql.usePingMethod=false -server -Xmx16g -Xms4g -Xss512k -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:LargePageSizeInBytes=128m -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -classpath /data1_1T/dolphinscheduler/bin/../conf:/data1_1T/dolphinscheduler/bin/../lib/* org.apache.dolphinscheduler.server.master.MasterServer
eschedu+  2818     1  0 15:45 ?        00:00:31 /usr/java/jdk1.8.0_144/bin/java -Dlogging.config=classpath:worker_logback.xml -Ddruid.mysql.usePingMethod=false -server -Xmx16g -Xms4g -Xss512k -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:LargePageSizeInBytes=128m -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -classpath /data1_1T/dolphinscheduler/bin/../conf:/data1_1T/dolphinscheduler/bin/../lib/* org.apache.dolphinscheduler.server.worker.WorkerServer
eschedu+  2925     1  0 15:45 ?        00:00:03 /usr/java/jdk1.8.0_144/bin/java -server -Xmx16g -Xms4g -Xss512k -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:LargePageSizeInBytes=128m -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -classpath /data1_1T/dolphinscheduler/bin/../conf:/data1_1T/dolphinscheduler/bin/../lib/* org.apache.dolphinscheduler.server.rpc.LoggerServer
eschedu+  3059     1  1 15:45 ?        00:00:51 /usr/java/jdk1.8.0_144/bin/java -Dlogging.config=classpath:apiserver_logback.xml -Dspring.profiles.active=api -server -Xmx16g -Xms4g -Xss512k -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:LargePageSizeInBytes=128m -XX:+UseFastAccessorMethods -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -classpath /data1_1T/dolphinscheduler/bin/../conf:/data1_1T/dolphinscheduler/bin/../lib/* org.apache.dolphinscheduler.api.ApiApplicationServer

登录页面

http://192.168.xx.xx:12345/dolphinscheduler
admin/dolphinscheduler123

10,其他常见问题

1)密码输入错误

如果登录不对,将sql/dolphinscheduler_mysql.sql中的

INSERT INTO `t_ds_user` VALUES (1, 'admin', '7ad2410b2f4c074479a8937a28a22b8f', 0, 'xxx@qq.com', 'xx', 0, '2018-03-27 15:48:50', '2018-10-24 17:40:22', NULL);

再次导入数据库就可以了

2)java.sql.SQLException: null,  message from server: "Host 'x.x.x.x' is blocked because of many connection errors; unblock with 'mysqladmin flush-hosts'"

2.1)直接修改mysql的show global variables like '%max_connect_errors%';,直接修改max_connect_errors的数量

2.2)进入mysql的控制台,flush hosts 刷新下所有的host 

3)服务启动,停止

sh start-all.sh

sh stop-all.sh

4)/data1_1T/dolphinscheduler 赋予escheduler权限

 

 

 

 

 

  

posted @ 2020-12-14 16:44  春江潮水连海平  阅读(963)  评论(0编辑  收藏  举报