|NO.Z.00033|——————————|^^ 部署 ^^|——|Hadoop&azkaban.V05|——|azkaban.v05|azkaban.multiple-executor模式部署.v01|

一、multiple-executor模式部署

### --- [azkaban]

~~~     [azkaban-solo-server部署使用]
~~~     [azkaban-multiple-server模式部署-webserver配置]
~~~     [azkaban-multiple-server模式部署-exec-server配置]
~~~     [azkaban-multiple-启动验证]

### --- 安装所需软件

~~~     # Azkaban Web服务安装包
        azkaban-web-server-0.1.0-SNAPSHOT.tar.gz
~~~     # Azkaban执行服务安装包
        azkaban-exec-server-0.1.0-SNAPSHOT.tar.gz
~~~     # sql脚本
        azkaban-db-0.1.0-SNAPSHOT.tar.gz

二、节点规划

HOST	角色
linux123	mysql，exec-server
linux122	web-server
linux121	exec-server

三、数据库准备

### --- linux123：进入mysql的客户端执行以下命令

[root@linux123 ~]# mysql -uroot -p

### --- 执行以下命令：

~~~     # 创建用户及表
~~~     # 更改密码强度
SET GLOBAL validate_password_length=5;
~~~     # 更改策略
SET GLOBAL validate_password_policy=0;
~~~     # 创建用户
CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban';
GRANT all privileges ON azkaban.* to 'azkaban'@'%' identified by 'azkaban' WITH GRANT OPTION;
CREATE DATABASE azkaban;
use azkaban;

### --- 解压数据库脚本

[root@linux123 azkaban]# cd /opt/yanqi/software/azkaban
tar -zxvf azkaban-db-0.1.0-SNAPSHOT.tar.gz -C /opt/yanqi/servers/azkaban

### --- 加载初始化sql创建表

mysql> source /opt/yanqi/servers/azkaban/azkaban-db-0.1.0-SNAPSHOT/create-all-sql-0.1.0-SNAPSHOT.sql;

四、配置Azkaban-web-server

### --- 进入linux122节点：解压azkaban-web-server

[root@linux122 ~]# mkdir /opt/yanqi/servers/azkaban
[root@linux122 ~]# cd /opt/yanqi/software/azkaban/
[root@linux122 azkaban]# tar -zxvf azkaban-web-server-0.1.0-SNAPSHOT.tar.gz -C /opt/yanqi/servers/azkaban/

### --- 进入azkaban-web-server根目录下；生成ssl证书文件；

[root@linux122 ~]# cd /opt/yanqi/servers/azkaban/azkaban-web-server-0.1.0-SNAPSHOT
~~~     # 生成ssl证书：
[root@linux122 azkaban-web-server-0.1.0-SNAPSHOT]# keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password:  
Re-enter new password: 
What is your first and last name?
  [Unknown]:  
What is the name of your organizational unit?
  [Unknown]:  
What is the name of your organization?
  [Unknown]:  
What is the name of your City or Locality?
  [Unknown]:  
What is the name of your State or Province?
  [Unknown]:  
What is the two-letter country code for this unit?
  [Unknown]:  
Is CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=Unknown correct?
  [no]:  y

Enter key password for <jetty>
    (RETURN if same as keystore password):  
Re-enter new password: 

~~~     # 注意：

~~~     运行此命令后,会提示输入当前生成keystore的密码及相应信息,
~~~     输入的密码请记住(所有密码统一以azkaban输入)

### --- 修改 azkaban-web-server的配置文件

[root@linux122 ~]# vim /opt/yanqi/servers/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/conf/azkaban.properties

# Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=My Local Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai # 时区注意后面不要有空格     
 
# Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml
 
# Azkaban Jetty server properties. 开启使⽤用ssl 并且知道端口
jetty.use.ssl=true
jetty.port=8443
jetty.maxThreads=25

# KeyStore for SSL ssl相关配置 注意密码和证书路径
jetty.keystore=keystore
jetty.password=azkaban
jetty.keypassword=azkaban
jetty.truststore=keystore
jetty.trustpassword=azkaban
 
# Azkaban mysql settings by default. Users should configure their own usernameand password.
database.type=mysql
mysql.port=3306
mysql.host=linux123
mysql.database=azkaban
mysql.user=root
mysql.password=12345678
mysql.numconnections=100
 
#Multiple Executor 设置为false
azkaban.use.multiple.executors=true
#azkaban.executorselector.filters=StaticRemainingFlowSize,MinimumFreeMemory,CpuStatus
azkaban.executorselector.comparator.NumberOfAssignedFlowComparator=1
azkaban.executorselector.comparator.Memory=1
azkaban.executorselector.comparator.LastDispatched=1
azkaban.executorselector.comparator.CpuUsage=1

### --- 添加属性
[root@linux122 ~]# cd /opt/yanqi/servers/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/
[root@linux122 azkaban-web-server-0.1.0-SNAPSHOT]# mkdir mkdir -p plugins/jobtypes

[root@linux122 azkaban-web-server-0.1.0-SNAPSHOT]# vim plugins/jobtypes/commonprivate.properties
# 添加如下内容
azkaban.native.lib=false
execute.as.user=false
memCheck.enabled=false

---

 

 

 

 

 

 

 

 

 

---

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart

                                                                                                                                                   ——W.S.Landor

---