hadoop配置webUI日志(解决web jobhistory没有job日志记录问题)
配置mapred-site.xml
<configuration>
<!-- 设置jobhistoryserver 没有配置的话 history入口不可用 -->
<property>
<name>mapreduce.jobhistory.address</name>
<value>localhost:10020</value>
</property>
<!-- 配置web端口 -->
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>localhost:19888</value>
</property>
<property>
<name>mapreduce.jobhistory.done-dir</name>
<value>/history/done</value>
</property>
<property>
<name>mapreduce.jobhistory.intermediate-done-dir</name>
<value>/history/done_intermediate</value>
</property>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
配置yarn-site.xml
<configuration>
<!-- Site specific YARN configuration properties -->
<!-- 开启日志聚合 -->
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>
重启historyserver服务
./mr-jobhistory-daemon.sh start historyserver
./mr-jobhistory-daemon.sh start historyserver
查看端口号是否启动成功
netstat -nltp
跑一个job
hadoop jar hadoop-mr-counter-2.9.1.jar com.org.chapter7.counter.ToolRunnerJS_Demo7_1 input output(这里是我自己的一个jar包,仅供参考)
打开浏览器,进入localhost:19888
转载请带上本文连接,谢谢!