二十:CDH5.14离线安装kafka (含版本选择)
一:当安装好CDH的hadoop后,准备安装kafka,可是CDH上添加服务是这样的,没法直接添加,需要添加相应包才可以:
Apache Kafka is publish-subscribe messaging rethought as a distributed commit log. Before adding this service, ensure that either the Kafka parcel is activated or the Kafka package is installed.
一切从官网开始:
https://www.cloudera.com/documentation.html
二:按安装向导选择从Parcel安装:
https://www.cloudera.com/documentation/kafka/latest/topics/kafka_installing.html#concept_m2t_d45_4r
2.1按步骤进入:
2.2:没有发现安装包,进行安装包选择:
https://www.cloudera.com/documentation/kafka/latest/topics/kafka_packaging.html#concept_fzg_phl_br
进入http://archive.cloudera.com/kafka/parcels/2.1.1/ 下载好
2.3 下载安装包到本地目录:
[[email protected] kafka_parcels]# pwd
/var/www/html/kafka_parcels
[[email protected] kafka_parcels]# ll
total 66456
-rw-r–r-- 1 root root 68034339 Feb 6 2018 KAFKA-2.1.1-1.2.1.1.p0.18-el7.parcel
-rw-r–r-- 1 root root 41 Feb 6 2018 KAFKA-2.1.1-1.2.1.1.p0.18-el7.parcel.sha
-rw-r–r-- 1 root root 5252 Feb 6 2018 manifest.json
[[email protected] kafka_parcels]#
三:CDH配置kafka 源:
检查更新并下载->分配:
-rw-r----- 1 cloudera-scm cloudera-scm 2107526476 Feb 22 22:43 CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel
-rw-r----- 1 cloudera-scm cloudera-scm 41 Feb 22 22:43 CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.sha
-rw-r----- 1 cloudera-scm cloudera-scm 80567 Feb 22 22:43 CDH-5.14.0-1.cdh5.14.0.p0.24-el7.parcel.torrent
-rw-r----- 1 cloudera-scm cloudera-scm 68034339 Feb 23 21:00 KAFKA-2.1.1-1.2.1.1.p0.18-el7.parcel
-rw-r----- 1 cloudera-scm cloudera-scm 41 Feb 23 21:00 KAFKA-2.1.1-1.2.1.1.p0.18-el7.parcel.sha
-rw-r----- 1 cloudera-scm cloudera-scm 2761 Feb 23 21:00 KAFKA-2.1.1-1.2.1.1.p0.18-el7.parcel.torrent
[[email protected] parcel-repo]# pwd
/opt/cloudera/parcel-repo
分配后:
lrwxrwxrwx 1 root root 28 Feb 22 22:46 CDH -> CDH-5.14.0-1.cdh5.14.0.p0.24
drwxr-xr-x 11 root root 4096 Jan 7 2018 CDH-5.14.0-1.cdh5.14.0.p0.24
drwxr-xr-x 6 root root 4096 Mar 25 2017 KAFKA-2.1.1-1.2.1.1.p0.18
[[email protected] parcels]# ll
total 8
**后:
lrwxrwxrwx 1 root root 28 Feb 22 22:46 CDH -> CDH-5.14.0-1.cdh5.14.0.p0.24
drwxr-xr-x 11 root root 4096 Jan 7 2018 CDH-5.14.0-1.cdh5.14.0.p0.24
lrwxrwxrwx 1 root root 25 Feb 23 21:04 KAFKA -> KAFKA-2.1.1-1.2.1.1.p0.18
drwxr-xr-x 6 root root 4096 Mar 25 2017 KAFKA-2.1.1-1.2.1.1.p0.18
[[email protected] parcels]# pwd
/opt/cloudera/parcels