【大数据环境准备】Hadoop伪分布部署(root用户)

编译好的hadoop安装

1:创建hadoop服务的一个用户

[[email protected] home]# useradd hadoop

[[email protected] home]# id hadoop

[[email protected] home]# vi /etc/sudoers

hadoop ALL=(root) NOPASSWD:ALL

 

2:确保ssh运行

[[email protected] ~]# service sshd status

3:解压hadoop

[[email protected] software]# tar -zxvf hadoop-2.8.1.tar.gz 

4:修改hadoop目录权限

[[email protected] software]# chown -R root:root hadoop-2.8.1

[[email protected] software]# chown -R root:root hadoop-2.8.1/*

/opt/software/hadoop-2.8.1

5:配置环境变量

[[email protected] hadoop-2.8.1]# vi /etc/profile

JAVA_HOME=/usr/java/jdk1.8.0_45

HADOOP_HOME=/opt/software/hadoop-2.8.1

export PATH=$HADOOP_HOME/bin:$JAVA_HOME/bin:$PATH

 

6:

[[email protected] hadoop-2.8.1]# which hadoop

[[email protected] software]# ln -s /opt/software/hadoop-2.8.1 hadoop

[[email protected] software]# chown -R hadoop:hadoop hadoop

[[email protected] software]# chown -R hadoop:hadoop hadoop/*

[[email protected] software]# chown -R hadoop:hadoop hadoop-2.8.1

[[email protected] software]# cd hadoop-2.8.1

[[email protected] hadoop-2.8.1]# cd bin/

[[email protected] bin]# rm -rf *.cmd

 

7:配置hadoop模块组件

[[email protected] hadoop-2.8.1]# cd /opt/software/hadoop-2.8.1/etc/hadoop/

[[email protected] hadoop]# vi core-site.xml

<configuration>

        <property>

                <name>fs.defaultFS</name>

                <value>hdfs://localhost:9000</value>

        </property>

</configuration>

 

[[email protected] hadoop]# vi hdfs-site.xml

<configuration>

        <property>

            <name>dfs.replication</name>

            <value>1</value>

        </property>

</configuration>

8:配置root用户ssh信任关系

[[email protected] home]# ssh-****** -t rsa -P '' -f ~/.ssh/id_rsa

 [[email protected] home]# cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

[[email protected] home]# chmod 0600 ~/.ssh/authorized_keys 

[[email protected] home]# cd ~/.ssh/

没有ssh客户端的安装openssh 客户端

[[email protected] .ssh]# yum install openssh-clients

 

[[email protected] .ssh]# ssh localhost date

修改文件

[[email protected] sbin]# vi /opt/software/hadoop-2.8.1/etc/hadoop/hadoop-env.sh 

export JAVA_HOME=/usr/java/jdk1.8.0_45

export HADOOP_PREFIX=//opt/software/hadoop-2.8.1

9:格式hadoop存在目录

[[email protected] sbin]# ./hdfs namenode -format

10:启动hadoop

[[email protected] sbin]# ./start-dfs.sh 

访问hadoop 

 http://192.168.43.133:50070/dfshealth.html#tab-overview