AWS-CDH5.5安装-软件下载

公告

View Post

1.下载安装介质

下载CM安装文件:

[root@ip-172-31-30-175 cm5.5.0]# wget -c -r -nd -np -k -L -A rpm http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:01 (369 MB/s) - ?.ndex.html?.saved [2831/2831]

Loading robots.txt; please ignore errors.
--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/robots.txt
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 404 Not Found
2015-12-01 07:55:01 ERROR 404: Not Found.

Removing index.html since it should be rejected.

--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:01 (731 MB/s) - ?.ndex.html?C=N;O=D?.saved [2831/2831]

Removing index.html?C=N;O=D since it should be rejected.

--2015-12-01 07:55:01--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (761 MB/s) - ?.ndex.html?C=M;O=A?.saved [2831/2831]

Removing index.html?C=M;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (758 MB/s) - ?.ndex.html?C=S;O=A?.saved [2831/2831]

Removing index.html?C=S;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:55:02 (744 MB/s) - ?.ndex.html?C=D;O=A?.saved [2831/2831]

Removing index.html?C=D;O=A since it should be rejected.

--2015-12-01 07:55:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 4897544 (4.7M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 4,897,544   3.09M/s   in 1.5s    

2015-12-01 07:55:03 (3.09 MB/s) - ?.loudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [4897544/4897544]

--2015-12-01 07:55:03--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 533925676 (509M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 533,925,676 3.90M/s   in 1m 58s  

2015-12-01 07:57:02 (4.30 MB/s) - ?.loudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [533925676/533925676]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 8388 (8.2K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 8,388       --.-K/s   in 0s      

2015-12-01 07:57:02 (170 MB/s) - ?.loudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [8388/8388]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 10128 (9.9K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 10,128      --.-K/s   in 0s      

2015-12-01 07:57:02 (165 MB/s) - ?.loudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [10128/10128]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 979964 (957K) [application/x-redhat-package-manager]
Saving to: ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 979,964     4.88M/s   in 0.2s    

2015-12-01 07:57:02 (4.88 MB/s) - ?.nterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm?.saved [979964/979964]

--2015-12-01 07:57:02--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/jdk-6u31-linux-amd64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 71204325 (68M) [application/x-redhat-package-manager]
Saving to: ?.dk-6u31-linux-amd64.rpm?

100%[=====================================================================================================================================================================>] 71,204,325  4.58M/s   in 15s     

2015-12-01 07:57:18 (4.39 MB/s) - ?.dk-6u31-linux-amd64.rpm?.saved [71204325/71204325]

--2015-12-01 07:57:18--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 142039186 (135M) [application/x-redhat-package-manager]
Saving to: ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?

100%[=====================================================================================================================================================================>] 142,039,186 4.59M/s   in 30s     

2015-12-01 07:57:48 (4.58 MB/s) - ?.racle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm?.saved [142039186/142039186]

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=A
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=A?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (834 MB/s) - ?.ndex.html?C=N;O=A?.saved [2831/2831]

Removing index.html?C=N;O=A since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (827 MB/s) - ?.ndex.html?C=M;O=D?.saved [2831/2831]

Removing index.html?C=M;O=D since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (806 MB/s) - ?.ndex.html?C=S;O=D?.saved [2831/2831]

Removing index.html?C=S;O=D since it should be rejected.

--2015-12-01 07:57:48--  http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=D
Reusing existing connection to archive-primary.cloudera.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 2831 (2.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=D?

100%[=====================================================================================================================================================================>] 2,831       --.-K/s   in 0s      

2015-12-01 07:57:48 (804 MB/s) - ?.ndex.html?C=D;O=D?.saved [2831/2831]

Removing index.html?C=D;O=D since it should be rejected.

FINISHED --2015-12-01 07:57:48--
Downloaded: 16 files, 718M in 2m 45s (4.35 MB/s)
Converted 0 files in 0 seconds.
[root@ip-172-31-30-175 cm5.5.0]#

检查下载文件与官网大小是否一致,经常会发生在传输过程中出差，所以务必要检查您的安装文件和Cloudera官网上的大小一致:

[root@ip-172-31-30-175 cm5.5.0]# ls -l
total 735432
-rw-r--r-- 1 root root   4897544 Nov 17 05:29 cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root 533925676 Nov 17 05:29 cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root      8388 Nov 17 05:29 cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root     10128 Nov 17 05:29 cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root    979964 Nov 17 05:29 enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
-rw-r--r-- 1 root root  71204325 Nov 17 05:29 jdk-6u31-linux-amd64.rpm
-rw-r--r-- 1 root root 142039186 Nov 17 05:29 oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

2.下载CDH parcel及manifest文件:

[root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
--2015-12-01 08:08:43-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1485836821 (1.4G)
Saving to: ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?

100%[===================================================================================================================================================================>] 1,485,836,821 5.26M/s in 4m 44s

2015-12-01 08:13:27 (5.00 MB/s) - ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?.saved [1485836821/1485836821]

[root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
--2015-12-01 08:16:29-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 49710 (49K) [application/json]
Saving to: ?.anifest.json?

100%[=====================================================================================================================================================================>] 49,710 --.-K/s in 0.1s

2015-12-01 08:16:30 (347 KB/s) - ?.anifest.json?.saved [49710/49710]

检查文件大小：

[root@ip-172-31-30-175 cdh5.5.0]# ll
total 1451072
-rw-r--r-- 1 root root 1485836821 Nov 12 19:32 CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
-rw-r--r-- 1 root root      49710 Nov 12 19:32 manifest.json
[root@ip-172-31-30-175 cdh5.5.0]#

3.下载MySQL5.6和JDBC Driver

[root@ip-172-31-30-175 cloudera]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
--2015-12-01 08:18:13--  http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm [following]
--2015-12-01 08:18:13--  http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 55950588 (53M) [application/x-redhat-package-manager]
Saving to: ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 55,950,588  4.98M/s   in 11s     

2015-12-01 08:18:24 (5.08 MB/s) - ?.ySQL-server-5.6.27-1.el6.x86_64.rpm?.saved [55950588/55950588]

[root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
--2015-12-01 08:24:01-- http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm [following]
--2015-12-01 08:24:01-- http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 18596528 (18M) [application/x-redhat-package-manager]
Saving to: ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 18,596,528 15.5M/s in 1.1s

2015-12-01 08:24:03 (15.5 MB/s) - ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?.saved [18596528/18596528]

[root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
--2015-12-01 08:20:50--  http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz [following]
--2015-12-01 08:20:50--  http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3928553 (3.7M) [application/x-tar-gz]
Saving to: ?.ysql-connector-java-5.1.37.tar.gz?

100%[=====================================================================================================================================================================>] 3,928,553   --.-K/s   in 0.1s    

2015-12-01 08:20:50 (29.7 MB/s) - ?.ysql-connector-java-5.1.37.tar.gz?.saved [3928553/3928553]

检查大小:

[root@ip-172-31-30-175 mysql]# ll
total 76644
-rw-r--r-- 1 root root 18596528 Sep 21 16:32 MySQL-client-5.6.27-1.el6.x86_64.rpm
-rw-r--r-- 1 root root 3928553 Oct 6 13:24 mysql-connector-java-5.1.37.tar.gz
-rw-r--r-- 1 root root 55950588 Sep 21 16:33 MySQL-server-5.6.27-1.el6.x86_64.rpm

注意：这里还需要下载两个文件：MySQL-devel-5.6.27-1.el6.x86_64.rpm MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm，最后的文件目录应该如下:

[root@ip-172-31-30-175 mysql]# ls 
MySQL-client-5.6.27-1.el6.x86_64.rpm  mysql-connector-java-5.1.37.zip      MySQL-server-5.6.27-1.el6.x86_64.rpm
mysql-connector-java-5.1.37           MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm

posted on 2015-12-02 15:07 littlesuccess 阅读(489) 评论(0) 编辑收藏举报

刷新页面返回顶部