Datanode和Namenode運行但未反映在UI

我在Hadoop中配置主從服務器時遇到了一些小挫折，並且我的主服務器和從服務器中的名稱節點和數據節點都已啓動並正在運行。Datanode和Namenode運行但未反映在UI

但是，WebUI中的LiveNodes計數沒有得到反映，但節點正在運行。

我已經嘗試禁用防火牆和格式化節點，但我無法解決相同的問題。

任何幫助將不勝感激！

下面是片段：

站長：

JPS命令輸出：

5088 JPS

4446的NameNode

4681 SecondaryNameNode

從屬：

個

JPS命令輸出：

2478 JPS

2410數據管理部Hadoop的從屬-1

[email protected]:/usr/local/hadoop/etc/hadoop$ $HADOOP_HOME/bin/hdfs dfsadmin -refreshNodes 
16/04/28 02:22:37 WARN ipc.Client: Address change detected. Old: hadoop-master/52.200.230.29:50077 New: hadoop-master/127.0.0.1:50077 
refreshNodes: Call From hadoop-master/127.0.0.1 to hadoop-master:50077 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused

日誌文件：Hadoop的主

2016-04-28 21:23:07,248 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000 
2016-04-28 21:23:12,257 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000 
2016-04-28 21:23:17,265 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000 
2016-04-28 21:23:22,273 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000 
2016-04-28 21:23:27,282 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000 
2016-04-28 21:23:32,291 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Problem connecting to server: hadoop-master/52.200.230.29:9000

日誌文件：

2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Roll Edit Log from 127.0.0.1 
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Rolling edit logs 
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 407 
2016-04-28 21:21:04,002 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 22 
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 3 SyncTimes(ms): 23 
2016-04-28 21:21:04,003 INFO org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits file /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_inprogress_0000000000000000407 -> /usr/local/hadoop/hadoop_data/hdfs/namenode/current/edits_0000000000000000407-0000000000000000408 
2016-04-28 21:21:04,004 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at 409

在我的母盤210

的netstat命令-pant：

[email protected]:/usr/local/hadoop/etc/hadoop$ netstat -pant 
(Not all processes could be identified, non-owned process info 
will not be shown, you would have to be root to see it all.) 
Active Internet connections (servers and established) 
Proto Recv-Q Send-Q Local Address   Foreign Address   State  PID/Program name 
tcp  0  0 0.0.0.0:50070   0.0.0.0:*    LISTEN  21491/java 
tcp  0  0 0.0.0.0:22    0.0.0.0:*    LISTEN  - 
tcp  0  0 0.0.0.0:50077   0.0.0.0:*    LISTEN  - 
tcp  0  0 127.0.0.1:50078   0.0.0.0:*    LISTEN  21491/java 
tcp  0  0 0.0.0.0:9000   0.0.0.0:*    LISTEN  - 
tcp  0  0 0.0.0.0:50090   0.0.0.0:*    LISTEN  21726/java 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57225  ESTABLISHED 21491/java 
tcp  0  0 127.0.0.1:41471   127.0.0.1:50078   TIME_WAIT - 
tcp  0 124 172.31.63.189:22  128.235.8.68:56950  ESTABLISHED - 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57224  ESTABLISHED 21491/java 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57223  ESTABLISHED 21491/java 
tcp  0  0 172.31.63.189:22  128.235.8.68:57084  ESTABLISHED - 
tcp  0  0 172.31.63.189:22  58.218.204.215:39402 ESTABLISHED - 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57227  ESTABLISHED 21491/java 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57228  ESTABLISHED 21491/java 
tcp  0  0 172.31.63.189:50070  128.235.8.68:57226  ESTABLISHED 21491/java 
tcp6  0  0 :::22     :::*     LISTEN  - 
tcp6  0  0 :::50077    :::*     LISTEN  - 
tcp6  0  0 :::9000     :::*     LISTEN  -

來源

2016-04-28 Harinarayanan Mohan

，請複製粘貼NameNode和DataNode會記錄 – neeraj

嗨的幾行字，我已經編輯與日誌賈爾斯 –

的NameNode好像我的問題。但datanode無法連接到namenode。你有沒有修改namenode的端口號？我看到9000，而默認值是8020.驗證所有配置的地址是否正確 – neeraj

連接被拒絕 我可以從你的帖子看到這個錯誤。我猜你需要做3件事

確保50077端口是由一個過程聽，這是你的Hadoop過程
確保它能夠訪問使用一些工具，如遠程登錄
除了防火牆。 selinux也會影響訪問。所以將其關閉並重新啓動您的服務，然後再試一次

來源

2016-04-28 02:43:34

Datanode和Namenode運行但未反映在UI

回答

相關問題