Flume傳輸gzip文件

Question

我想將gzip文件傳輸到hdfs。我正在探索的選項是spooldir。我在指定spooldir的遠程位置時遇到了問題。任何建議請：

agent1.sources = src-1 
agent1.channels = c1 
agent1.sinks = k1 

agent1.sources.src-1.type = spooldir 
agent1.sources.src-1.channels = c1 
agent1.sources.src-1.hostname = ipaddress 
agent1.sources.src-1.spoolDir = /var/logs/webserver 
agent1.channels.c1.type = memory 

agent1.sinks.k1.type = hdfs 
agent1.sinks.k1.channel = c1 
agent1.sinks.k1.hdfs.path = hdfspath 
agent1.sinks.k1.hdfs.fileType = CompressedStream 
agent1.sinks.k1.hdfs.round = true 
agent1.sinks.k1.hdfs.roundValue = 10 
agent1.sinks.k1.hdfs.roundUnit = minute 

Answer 1

假脫機目錄源需要指向flume運行本地系統上的目錄。此行對於假脫機目錄源不是有效的選項：

agent1.sources.src-1.hostname = ipaddress