Centos6.5下Hadoop-CDH版为分布式集群搭建
尾部有另一个安装教程截图:
首先安装jdk,下载jdk:http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html
然后拷贝解压:
tar -zxvf jdk-8u172-linux-x64.tar.gz -C /usr/local/
修改权限:chown -R test.nimrod jdk1.8.0_172/
配置环境变量:vim ~/.bash_profile
source ~/.bash_profile
测试成功:
下载Hadoop:http://archive.cloudera.com/cdh5/cdh/5/
HDFS配置:
拷贝解压到/home/test/Hadoop/app/
配置hadoop-env.sh:
export JAVA_HOME=/usr/local/jdk1.8.0_172
配置core-site.xml
<property>
<name>fs.defaultFS</name>
<value>hdfs://node40:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/test/app/tmp</value>
</property>
配置hdfs-site.xml
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
伪分布式不用配置slaves
启动hdfs:进入到bin中运行:hdfs namenode -format --------------格式化文件系统,执行一次即可,不用 重复执行
进入到sbin里面,启动namenode和datanode
查看进程:
网页查看:
基本操作:
配置hadoop目录:vim ~/.bash_profile
PATH=$PATH:$HOME/bin
export JAVA_HOME=/usr/local/jdk1.8.0_172 #这里路径为自己解压的JDK的路径
export CLASSPATH=${JAVA_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH
# Hadoop Environment Variables
export HADOOP_HOME=/home/test/app/hadoop-2.6.0-cdh5.9.2
export HADOOP_INSTALL=$HADOOP_HOME
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin
export PATH
截图教程:
配置YARN:
启动后结果:
停止:stop-all.sh