<kbd id="afajh"><form id="afajh"></form></kbd>
<strong id="afajh"><dl id="afajh"></dl></strong>
    <del id="afajh"><form id="afajh"></form></del>
        1. <th id="afajh"><progress id="afajh"></progress></th>
          <b id="afajh"><abbr id="afajh"></abbr></b>
          <th id="afajh"><progress id="afajh"></progress></th>

          查看YARN任務(wù)日志的幾種方式

          共 2943字,需瀏覽 6分鐘

           ·

          2020-07-28 13:22

          點(diǎn)擊上方藍(lán)色字體,選擇“設(shè)為星標(biāo)

          回復(fù)”資源“獲取更多資源

          大數(shù)據(jù)技術(shù)與架構(gòu)
          點(diǎn)擊右側(cè)關(guān)注,大數(shù)據(jù)開(kāi)發(fā)領(lǐng)域最強(qiáng)公眾號(hào)!

          暴走大數(shù)據(jù)
          點(diǎn)擊右側(cè)關(guān)注,暴走大數(shù)據(jù)!

          通過(guò)history server

          通過(guò)history server,直接在web ui上查看(如果任務(wù)異常退出,可能會(huì)看不到)

          ?

          通過(guò)yarn命令(用戶要和提交任務(wù)的用戶一致)

          yarn application -list -appStates ALL(這個(gè)不顯示時(shí)間信息)

          [hdfs@node1 opt]$ yarn application -list -appStates ALL17/07/26 10:51:33 INFO impl.TimelineClientImpl: Timeline service address: http://node2.hde.h3c.com:8188/ws/v1/timeline/17/07/26 10:51:33 INFO client.RMProxy: Connecting to ResourceManager at node2.hde.h3c.com/192.38.0.232:8050Total number of applications (application-types: [] and states: [NEW, NEW_SAVING, SUBMITTED, ACCEPTED, RUNNING, FINISHED, FAILED, KILLED]):2                Application-Id      Application-Name        Application-Type          User       Queue               State         Final-State         Progress                        Tracking-URLapplication_1500702983136_0002            word count               MAPREDUCE     ambari-qa     default            FINISHED           SUCCEEDED             100% http://node2.hde.h3c.com:19888/jobhistory/job/job_1500702983136_0002application_1500702983136_0001      DistributedShell                    YARN     ambari-qa     default            FINISHED           SUCCEEDED             100%                                 N/A

          yarn logs -applicationId application_1493700892407_0007

          [ambari-qa@node1 opt]$ yarn logs -applicationId application_1500702983136_000217/07/26 10:56:23 INFO impl.TimelineClientImpl: Timeline service address: http://node2.hde.h3c.com:8188/ws/v1/timeline/17/07/26 10:56:23 INFO client.RMProxy: Connecting to ResourceManager at node2.hde.h3c.com/192.38.0.232:805017/07/26 10:56:25 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library17/07/26 10:56:25 INFO compress.CodecPool: Got brand-new decompressor [.deflate]  Container: container_1500702983136_0002_01_000002 on node1.hde.h3c.com_45454==============================================================================LogType:stderrLog Upload Time:Sat Jul 22 01:59:41 -0400 2017LogLength:0Log Contents:End of LogType:stderr LogType:stdoutLog Upload Time:Sat Jul 22 01:59:41 -0400 2017LogLength:0Log Contents:End of LogType:stdout LogType:syslogLog Upload Time:Sat Jul 22 01:59:41 -0400 2017LogLength:3674Log Contents:2017-07-22 01:59:16,446 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-maptask.properties,hadoop-metrics2.properties

          直接查看hdfs路徑的log

          查看yarn-site.xml,確定log配置目錄

          <property>      <name>yarn.nodemanager.remote-app-log-dirname>      <value>/app-logsvalue>property>```2)查看日志文件信息(注意日期和時(shí)間)[hdfs@node1 root]$ hdfs dfs -ls /app-logs/hdfs/logsFound 1 itemsdrwxrwx---   - hdfs hadoop          0 2017-05-02 04:18 /app-logs/hdfs/logs/application_1493700892407_00073)查看日志詳情(注意查看節(jié)點(diǎn)重啟前的幾個(gè)敏感app)yarn logs -applicationId application_1493700892407_0007(同2)


          歡迎點(diǎn)贊+收藏+轉(zhuǎn)發(fā)朋友圈素質(zhì)三連


          文章不錯(cuò)?點(diǎn)個(gè)【在看】吧!??

          瀏覽 117
          點(diǎn)贊
          評(píng)論
          收藏
          分享

          手機(jī)掃一掃分享

          分享
          舉報(bào)
          評(píng)論
          圖片
          表情
          推薦
          點(diǎn)贊
          評(píng)論
          收藏
          分享

          手機(jī)掃一掃分享

          分享
          舉報(bào)
          <kbd id="afajh"><form id="afajh"></form></kbd>
          <strong id="afajh"><dl id="afajh"></dl></strong>
            <del id="afajh"><form id="afajh"></form></del>
                1. <th id="afajh"><progress id="afajh"></progress></th>
                  <b id="afajh"><abbr id="afajh"></abbr></b>
                  <th id="afajh"><progress id="afajh"></progress></th>
                  国产欧美日韩免费看 | 亚洲AV首页 | 欧美国产在线观看 | 婷婷六月综合 | 一区二区视频 |