添加頭HTTP帖子內容水槽

Question

我測試了水槽HTTP來源與HDFS作爲水槽。以下是使用的conf文件。

httpagent.sources = httpsource 
httpagent.sinks = hdfs-file-sink 
httpagent.channels = ch3 

httpagent.sources.httpsource.type = http 
httpagent.sources.httpsource.bind = address 
httpagent.sources.httpsource.handler =org.apache.flume.sink.solr.morphline.BlobHandler httpagent.sources.httpsource.channels = ch3 
httpagent.sources.httpsource.port = port 


httpagent.sinks.hdfs-file-sink.type = hdfs 
httpagent.sinks.hdfs-file-sink.hdfs.path = hdfs://localhost:8020/flume/events 
httpagent.sinks.hdfs-file-sink.hdfs.fileType=DataStream 
httpagent.sinks.hdfs-file-sink.hdfs.filePrefix = events- 
httpagent.sinks.hdfs-file-sink.hdfs.rollInterval = 30 
httpagent.sinks.hdfs-file-sink.channel = ch3 
httpagent.channels.ch3.type = memory 

請求正文被保存在HDFS中。但我想追加HTTP標題以及發佈內容。我怎麼做？

Answer 1

你可能想看看事件序列化（https://flume.apache.org/FlumeUserGuide.html#event-serializers）

截至https://flume.apache.org/FlumeUserGuide.html#hdfs-sink

描述如果你想在頭串行器可以設置，您應該與Avro的事件串行去或寫自定義一個。