我想在cygwin的在Windows 7我收到試圖運行一個簡單的工作時,以下問題安裝和啓動的Hadoop 1.1.2:爲什麼Hadoop在cygwin下使用Windows 7?
bin/hadoop jar hadoop-*-examples.jar pi 10 100
13/04/26 17:56:10 WARN hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/username/PiEstimator_TMP_3_141592654/in/part0 could only be replicated to 0 nodes, instead of 1
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1639)
at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:736)
at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
我的配置如下:
mapred-site.xml中
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
</configuration>
HDFS-site.xml中
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
哪個日誌?有這麼多... namenode,secondarynamenode,taskrunner,jobtracker ... – Rolando 2013-04-27 05:19:02
@Damascusi:檢查所有的日誌。或者一個簡單的方法是啓動dfs,然後再次運行啓動腳本 - 它應該顯示所有節點都在運行,而不是某個節點正在啓動。檢查未正常運行的節點的日誌。 – nhahtdh 2013-04-27 05:25:57
我執行了start-all.sh腳本。 start-all和start-dfs之間有什麼不同嗎? – Rolando 2013-04-27 05:27:04