2013-10-21 103 views
1

我有一個3節點hbase集羣在亞馬遜Ec2上運行。這工作得很好。現在,我嘗試使用兩個單獨的插入查詢將數據從EMR插入到EC2。因此,第一次插入查詢完美無缺,並插入數據,之後,我的所有區域服務器都變得死亡。那麼,你能否建議我調試這個問題的一般指導方針,以及爲什麼一般地區服務器會死亡? 此外,即使我明確地啓動區域服務器後,他們再次成爲死亡。區域服務器死機的原因

更新問題:

前,我想這可能是一個問題,由於HBASE_HEAPSIZE這是默認設置爲1GB。但我也增加到5.5 Gb仍然區域服務器正在死亡。 下面是我在每個區域服務器上死後的日誌。

2013-10-07 18:16:27,949 WARN org.apache.zookeeper.ClientCnxn: Session 0x141916dfbe50000 for server null, unexpected error, closing socket connection and attempting rec$ 
java.net.ConnectException: Connection refused 
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) 
     at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:597) 
     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) 
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 
2013-10-07 18:16:27,990 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: localhost/10.179.42.93:50020. Already tried 1 time(s). 
2013-10-07 18:16:28,049 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server master/10.179.42.93:2181 
2013-10-07 18:16:28,049 INFO org.apache.zookeeper.client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client'$ 
2013-10-07 18:16:28,049 WARN org.apache.zookeeper.ClientCnxn: Session 0x141916dfbe50001 for server null, unexpected error, closing socket connection and attempting rec$ 
java.net.ConnectException: Connection refused 
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) 
     at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:597) 
     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) 
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 
2013-10-07 18:16:28,177 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server slave/10.178.5.52:2181 
2013-10-07 18:16:28,177 INFO org.apache.zookeeper.client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client'$ 
2013-10-07 18:16:28,178 WARN org.apache.zookeeper.ClientCnxn: Session 0x141916dfbe50001 for server null, unexpected error, closing socket connection and attempting rec$ 
java.net.ConnectException: Connection refused 
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) 
     at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:597) 
     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286) 
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 
+0

嗨Naresh。你找到了解決這個問題的方法嗎? –

回答

0

您可以檢查RegionServer的日誌。以下是有關日誌位置的更多信息。

如果必須在域服務器上時發出明確轉向,那麼它的問題的情況。

最好的方法是用HBASE創建一個新的EMR實例。

+0

我已經更新了我在地區服務器死後發現的日誌。我知道我們可以在EMR上旋轉Hbase instaces,但出於某種原因我們沒有使用。 – Naresh