2016-04-22 194 views
2

我正在嘗試usgin庫clj-kafkaclj-kafka - 消費者空

這裏我的代碼

(use [clj-kafka.producer] 
     [clj-kafka.zk] 
     [clj-kafka.consumer.zk] 
     [clj-kafka.core])) 

(brokers {"zookeeper.connect" "localhost:2181"}) 

(def p (producer {"metadata.broker.list" "localhost:9092" 
        "serializer.class" "kafka.serializer.DefaultEncoder" 
        "partitioner.class" "kafka.producer.DefaultPartitioner"})) 

(send-message p (message "test" (.getBytes "this is my message"))) 

(def config {"zookeeper.connect" "localhost:2181" 
      "group.id" "clj-kafka.consumer" 
      "auto.offset.reset" "smallest" 
      "auto.commit.enable" "false"}) 

(with-resource [c (consumer config)] 
    shutdown 
    (take 2 (messages c "test"))) ;; return() 

我開始zookepper服務器和卡夫卡本身

bin/zookeeper-server-start.sh config/zookeeper.properties 
bin/kafka-server-start.sh config/server.properties 

配置/ zookepper.properties:

dataDir=/tmp/zookeeper 
clientPort=2181 
maxClientCnxns=0 

和配置/ server.properties :

broker.id=0 
listeners=PLAINTEXT://:9092 
num.network.threads=3 
num.io.threads=8 
socket.send.buffer.bytes=102400 
zocket.receive.buffer.bytes=102400 
socket.request.max.bytes=104857600 
log.dirs=/tmp/kafka-logs 
num.partitions=1 
num.recovery.threads.per.data.dir=1 
log.retention.hours=168 
log.segment.bytes=1073741824 
log.retention.check.interval.ms=300000 
zookeeper.connect=localhost:2181 
zookeeper.connection.timeout.ms=6000 

'問題' 是,當我執行:這裏

(with-resource [c (consumer config)] 
    shutdown 
    (take 2 (messages c "test"))) ;; return empty() 

任何想法?

在此先感謝

回答

1

看到這個github上issue。似乎文檔不是很好。您必須強制使用doall實現序列(這是惰性的)。試試這個:

(with-resource [c (consumer config)] 
    shutdown 
    (doall (take 2 (messages c "test")))) 
+0

你好@ @你好。我錯過了這裏的細節。是的,文檔在這一點上失敗了。謝謝 – elf

+0

嗨, 如果我想採取所有消息的話題? Onde這是一個懶惰的序列,有可能嗎? (doseq [消息(消費者配置)「日誌」))]]] (讓log )'' – elf