hadoop配置webUI日志(解决web jobhistory没有job日志记录问题)

配置mapred-site.xml

<configuration>
	<!-- 设置jobhistoryserver 没有配置的话 history入口不可用 -->
	<property>
		<name>mapreduce.jobhistory.address</name>
		<value>localhost:10020</value>
	</property>
	<!-- 配置web端口 -->
	<property>
		<name>mapreduce.jobhistory.webapp.address</name>
		<value>localhost:19888</value>
	</property>
	<property>
	  <name>mapreduce.jobhistory.done-dir</name>
	  <value>/history/done</value>
	</property>
	<property>
	  <name>mapreduce.jobhistory.intermediate-done-dir</name>
	  <value>/history/done_intermediate</value>
	</property>
	<property>
		<name>mapreduce.framework.name</name>
		<value>yarn</value>
	</property>
</configuration>

配置yarn-site.xml

 <configuration>
<!-- Site specific YARN configuration properties -->
	<!-- 开启日志聚合 -->
	<property>
	<name>yarn.log-aggregation-enable</name>
	<value>true</value>
	</property>
	<property>
		<name>yarn.nodemanager.aux-services</name>
		<value>mapreduce_shuffle</value>
	</property>
</configuration>

重启historyserver服务
./mr-jobhistory-daemon.sh start historyserver
./mr-jobhistory-daemon.sh start historyserver
查看端口号是否启动成功
netstat -nltp

跑一个job
hadoop jar hadoop-mr-counter-2.9.1.jar com.org.chapter7.counter.ToolRunnerJS_Demo7_1 input output(这里是我自己的一个jar包,仅供参考)
打开浏览器,进入localhost:19888
hadoop配置webUI日志(解决web jobhistory没有job日志记录问题)
转载请带上本文连接,谢谢!