0
我是新來Kylokylo飼料保持運行,並沒有完成問題
我手動部署Kylo Hortonworks HDP 2.5的測試集羣和重用了我的Nifi實例。
我做了一個樣品飼料通過下面像攝入教程(用戶註冊),併成功。
但是,當我將示例數據文件放在/ var/dropzone /文件被刪除(假設它被Nifi讀取並讀取)並且feed在最近18小時內運行。對於一個小文件來說似乎太多了。
我看着nifi-app.log,只能找到貝洛錯誤,肯定是沒有幫助的
2017-05-29 09:38:41,045 INFO [Timer-Driven Process Thread-2] c.t.nifi.v2.common.FeedProcessor Resolving id ed2033a4-4bd5-4ea1-b9bc-2a48d69afef9 for feed/
2017-05-29 09:38:41,046 INFO [Timer-Driven Process Thread-5] c.t.nifi.v2.common.FeedProcessor Resolving ID for feed/
2017-05-29 09:38:41,048 INFO [Timer-Driven Process Thread-4] o.a.n.processors.standard.LogAttribute LogAttribute[id=01a8415a-0b38-14f2-8190-30f49a59ce2c] logging for flow file StandardFlowFileRecord[uuid=545885ac-eaa9-4387-b02a-a127594adc32,claim=,offset=0,name=19269191970708822,size=0]
--------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Mon May 29 09:38:40 AST 2017'
Key: 'lineageStartDate'
Value: 'Mon May 29 09:38:40 AST 2017'
Key: 'fileSize'
Value: '0'
FlowFile Attribute Map Content
Key: 'feedId'
Value: 'ed2033a4-4bd5-4ea1-b9bc-2a48d69afef9'
Key: 'filename'
Value: '19269191970708822'
Key: 'path'
Value: './'
Key: 'uuid'
Value: '545885ac-eaa9-4387-b02a-a127594adc32'
2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 47e9d23c-1b7f-4d64-8b2c-feb9e944838f. Event: ProvenanceEventRecordDTO{eventId=16975572, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=47e9d23c-1b7f-4d64-8b2c-feb9e944838f, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975572, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=47e9d23c-1b7f-4d64-8b2c-feb9e944838f, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975573, processorName=Load High Watermark, componentId=01a84157-0b38-14f2-d63d-c41fbd9c38a3, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=CREATE, eventDetails=null, isEndOfJob=false, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 574f778e-40f1-4fd4-863a-6d19613c127e. Event: ProvenanceEventRecordDTO{eventId=16975574, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975574, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=574f778e-40f1-4fd4-863a-6d19613c127e, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975575, processorName=Load High Watermark, componentId=01a84157-0b38-14f2-d63d-c41fbd9c38a3, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=CREATE, eventDetails=null, isEndOfJob=false, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 INFO [Timer-Driven Process Thread-8] c.t.n.p.cache.FeedFlowFileCacheUtil Ending the Job for Feed null and flowfile: 2236a2a0-27e7-4f7d-8fcf-79441fe43e86. Event: ProvenanceEventRecordDTO{eventId=16975576, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
2017-05-29 09:38:41,088 ERROR [Timer-Driven Process Thread-8] c.t.n.p.ProvenanceEventCollector Provenance: Cant find Feed for ProvenanceEventRecordDTO{eventId=16975576, processorName=Load High Watermark Failure, componentId=01a8415a-0b38-14f2-8190-30f49a59ce2c, flowFile=2236a2a0-27e7-4f7d-8fcf-79441fe43e86, previous=null, eventType=DROP, eventDetails=Auto-Terminated by success Relationship, isEndOfJob=true, isBatch=true, isStream=false, feed=null}
任何想法?
我已經編輯了問題,並附上了nifi流程快照。不知道我在找什麼,看起來所有的流程都運行良好。 – omer