hadoop部署yarn的简单记录

接着上一篇部署hdfs分布式文件系统的环境

 

一、修改配置

到namenode节点修改yarn-site.xml

[[email protected] hadoop]# pwd
/hadoop/hadoop-3.2.0/etc/hadoop
[[email protected] hadoop]# ll yarn-site.xml

如下:

<configuration>

<!-- Site specific YARN configuration properties -->

<property><name>yarn.resourcemanager.hostname</name><value>m1</value></property>

<property><name>yarn.nodemanager.aux-services</name><value>mapreduce_shuffle</value></property>

</configuration>

 

将配置文件再分发到其它的节点

 

 

二、启动服务

如果用root用户启动报错的话,

修改启动脚本在前面加入:

YARN_RESOURCEMANAGER_USER=root
HADOOP_SECURE_DN_USER=yarn
YARN_NODEMANAGER_USER=root

启动如果还报错:

localhost: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

试着ssh-copy-id -i [email protected]

再启动服务

 ./start-yarn.sh

 

三、验证

再查看进程