hadoop文件配置

1.cd /opt/你自己姓名首字母/hadoop-2.6.5/etc/hadoop/
vi hdfs-site.xml
将内的内容改为

dfs.nameservices
mycluster

dfs.ha.namenodes.mycluster nn1,nn2 dfs.namenode.rpc-address.mycluster.nn1 node01:8020 dfs.namenode.rpc-address.mycluster.nn2 node02:8020 dfs.namenode.http-address.mycluster.nn1 node01:50070 dfs.namenode.http-address.mycluster.nn2 node02:50070 dfs.namenode.shared.edits.dir qjournal://node01:8485;node02:8485;node03:8485/mycluster dfs.journalnode.edits.dir /var/~~fyf~~ /hadoop/ha/jn dfs.client.failover.proxy.provider.mycluster org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods sshfence dfs.ha.fencing.ssh.private-key-files /root/.ssh/id_dsa dfs.ha.automatic-failover.enabled true dfs.replication 3 删除线部分需自己改。

2.vi core-site.xml
同理改为

fs.defaultFS hdfs://node01:9000 hadoop.tmp.dir /var/fyf/hadoop/pseudo fs.defaultFS hdfs://mycluster ha.zookeeper.quorum node02:2181,node03:2181,node04:2181 ipc.client.connect.max.retries 100 Indicates the number of retries a client will make to establisha server connection. ipc.client.connect.retry.interval 10000 Indicates the number of milliseconds a client will wait for before retrying to establish a server connection.

3.vi slaves
删除里面的内容 加上
node02
node03
node04

4.安装hadoop
cd /opt/…
将文件夹分发给node02,3,4
scp –r …/ node02:pwd
scp –r …/ node03:pwd
scp –r …/ node04:pwd

也将hdfs-site.xml和core-site.xml分发到node02,3,4
-scp hdfs-site.xml core-site.xml node02:pwd
-scp hdfs-site.xml core-site.xml node03:pwd
-scp hdfs-site.xml core-site.xml node04:pwd

用xftp传zookeeper，安装zookeeper

(1.解压安装zookeeper
tar xf zookeeper-3.4.6.tar.gz -C /opt/…

(2.修改zookeeper的配置文件
cd /opt/…/zookeeper-3.4.6/conf

给zoo_sample.cfg改名
cp zoo_sample.cfg zoo.cfg
(3.vi zoo.cfg
改dataDir=/var/…/zk
加
server.1=node02:2888:3888
server.2=node03:2888:3888
server.3=node04:2888:3888

(4.把zookeeper分发给node03，node04
scp -r zookeeper-3.4.6/ node03:pwd
scp -r zookeeper-3.4.6/ node04:pwd

(5.给每台机子创建刚配置文件里的路径
mkdir -p /var/…/zk
对node02来说：
echo 1 > /var/…/zk/myid
cat /var/…/zk/myid
对node03来说：
echo 2 > /var/…/zk/myid
cat /var/…/zk/myid
对node04来说：
echo 3 > /var/…/zk/myid
cat /var/…/zk/myid
(6.在/etc/profile进行配置然后分发到node03,，04

scp /etc/profile node03:/etc
scp /etc/profile node04:/etc

(7.启动zookeeper
全部会话内输zkServer.sh start(node01内没有zookeeper)
然后用zkServer.sh status查看zookeeper节点的状态

开启后应该有一个leader

**当输入zk tab键后出来这个就对了，最后不要忘记关掉zookeeper
**