Kafka LeaderNotAvailableException運行幾天後

我有一個環境Kafka 0.8.2.1與Zookeeper 3.4.6在Java 8上，並且在Linux（Centos7）環境中工作正常。經過一段時間（大約1個月）後，Kafka不再使用消息發佈，包括來自控制檯消費者的消息發佈，導致以下例外情況。Kafka LeaderNotAvailableException運行幾天後

[2015-10-23 10:49:25,016] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,026] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,026] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: talBI (kafka.producer.async.DefaultEventHandler) [2015-10-23 10:49:25,138] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,146] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,147] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: talBI (kafka.producer.async.DefaultEventHandler) [2015-10-23 10:49:25,256] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,265] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,265] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: talBI (kafka.producer.async.DefaultEventHandler) [2015-10-23 10:49:25,377] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,390] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,390] ERROR Failed to collate messages by topic, partition due to: Failed to fetch topic metadata for topic: talBI (kafka.producer.async.DefaultEventHandler) [2015-10-23 10:49:25,500] WARN Error while fetching metadata [{TopicMetadata for topic talBI -> No partition metadata for topic talBI due to kafka.common.LeaderNotAvailableException}] for topic [talBI]: class kafka.common.LeaderNotAvailableException (kafka.producer.BrokerPartitionInfo) [2015-10-23 10:49:25,501] ERROR Failed to send requests for topics talBI with correlation ids in [0,8] (kafka.producer.async.DefaultEventHandler) [2015-10-23 10:49:25,502] ERROR Error in handling batch of 1 events (kafka.producer.async.ProducerSendThread) kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries. 
     at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90) 
     at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:105) 
     at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:88) 
     at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:68) 
     at scala.collection.immutable.Stream.foreach(Stream.scala:547) 
     at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:67) 
     at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:45)

在話題的描述是導致以下似乎正常：

Topic:talBI  PartitionCount:1  ReplicationFactor:1  Configs: 
    Topic: talBI Partition: 0 Leader: 1  Replicas: 1  Isr: 1

我試圖運行具有以下命令卡夫卡首選副本選舉的命令行工具，但它仍然給同樣的問題。

kafka-preferred-replica-election --zookeeper md1qacat01.lnx.ix.com:2181/kafka

由於我們在生產中使用卡夫卡進行評估，因此仍然處於質量保證環境。任何想法是否我錯過了一些配置或可能發生了什麼？

來源

2015-10-23 aseychell

當您的網絡設置發生變化時，我看到了這種行爲。
您可以嘗試在KAFKA server.properties中設置advertised.host.name =「kafka server hostname」，然後重試。

來源

2015-10-23 09:46:36 leshkin

Kafka LeaderNotAvailableException運行幾天後

回答

相關問題