0
我正在嘗試配置flink歷史記錄服務器。我遵循flink文件here。我能夠啓動歷史記錄服務器,但只能看到已完成的作業,而不能看到正在運行的作業。我是否錯過了一些東西,或者它只是在歷史記錄服務器中顯示完成的作業。請幫助。Flink歷史記錄服務器未顯示正在運行的應用程序
喬布斯目前在集羣:
本地主機:8081/joboverview
{
"running": [
{
"jid": "e4e6edb76b887054d7aca460b7136937",
"name": "Filter",
"state": "RUNNING",
"start-time": 1505971363801,
"end-time": -1,
"duration": 11588615,
"last-modification": 1505971363832,
"tasks": {
"total": 1,
"pending": 0,
"running": 1,
"finished": 0,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
],
"finished": [
{
"jid": "ec16f4cf01192268150c750966cefd0d",
"name": "Flink Java Job at Thu Sep 21 10:52:09 IST 2017",
"state": "FINISHED",
"start-time": 1505971329989,
"end-time": 1505971330746,
"duration": 757,
"last-modification": 1505971330746,
"tasks": {
"total": 3,
"pending": 0,
"running": 0,
"finished": 3,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
]
}
歷史上的服務器提供
喬布斯
本地主機:8082/joboverview
{
"running": [],
"finished": [
{
"jid": "ec16f4cf01192268150c750966cefd0d",
"name": "Flink Java Job at Thu Sep 21 10:52:09 IST 2017",
"state": "FINISHED",
"start-time": 1505971329989,
"end-time": 1505971330746,
"duration": 757,
"last-modification": 1505971330746,
"tasks": {
"total": 3,
"pending": 0,
"running": 0,
"finished": 3,
"canceling": 0,
"canceled": 0,
"failed": 0
}
}
]
}
弗林克歷史服務器配置:
#==============================================================================
# HistoryServer
#==============================================================================
# The HistoryServer is started and stopped via bin/historyserver.sh (start|stop)
# Directory to upload completed jobs to. Add this directory to the list of
# monitored directories of the HistoryServer as well (see below).
jobmanager.archive.fs.dir: hdfs://<hdfs>:8020/sax/flink/jobmanager
# The address under which the web-based HistoryServer listens.
historyserver.web.address: localhost
# The port under which the web-based HistoryServer listens.
historyserver.web.port: 8082
# Comma separated list of directories to monitor for completed jobs.
historyserver.archive.fs.dir: hdfs://<hdfs>:8020/sax/flink/jobmanager
# Interval in milliseconds for refreshing the monitored directories.
historyserver.archive.fs.refresh-interval: 10000
非常感謝您的回覆。是的,我瀏覽了文檔並清楚地看到只有完成的作業纔會顯示在歷史記錄服務器中。我很困惑,因爲我將它與火花歷史記錄服務器進行比較,我們可以看到運行和完成的作業。在Flink中,我能夠看到運行json並完成,但運行的json始終爲空。這就是我發佈這個問題來澄清我的疑惑的原因。 – far2c
運行總是空的?你能否用更多的信息更新這個問題,以便我們看看究竟是什麼錯誤。否則,如果答案對您有幫助,您可以將其標記爲已接受。 –