2014-09-06 104 views
0

您好目前我正在運行hadoop 2.4.1。我創建使用eclipse一個簡單的Java程序DefaultMapperClass.java並打包成ex1.jarHadoop不與資源管理器通信

當我嘗試使用該命令將通過Hadoop的外殼來調用這個程序,

**hadoop jar /home/Maddy/ex1.jar DefaultMapperClass hdfs://localhost/users/root/input/Hadoop.txt hdfs://localhost/users/root/output** 

我得到下面的輸出Hadoop的外殼

**[[email protected] Maddy]# hadoop jar /home/Maddy/ex1.jar DefaultMapperClass hdfs://localhost/users/root/input/Hadoop.txt hdfs://localhost/users/root/output 
14/09/05 19:26:35 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
Job started: Fri Sep 05 19:26:35 CDT 2014 
14/09/05 19:26:35 INFO client.RMProxy: Connecting to ResourceManager at localhost/127.0.0.1:8032 
[[email protected] Maddy]#** 

看起來像Hadoop的外殼試圖連接到資源管理器,但不成功,但沒有錯誤消息

MAPR ED-site.xml文件:

**<configuration> 
    <property> 
     <name>mapreduce.framework.name</name> 
     <value>yarn</value> 
    </property> 
</configuration>** 

紗-site.xml中:

**<configuration> 
    <property> 
     <name>yarn.nodemanager.aux-services</name> 
     <value>mapreduce_shuffle</value> 
    </property> 
<property> 
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> 
    <value>org.apache.hadoop.mapred.ShuffleHandler</value> 
</property> 
<property> 
<name>yarn.resourcemanager.address</name> 
<value>localhost:8032</value> 
</property> 
<property> 
<name>yarn.resourcemanager.scheduler.address</name> 
<value>localhost:8030</value> 
</property> 
<property> 
<name>yarn.resourcemanager.resource-tracker.address</name> 
<value>localhost:8031</value> 
</property> 
</configuration>** 

缺少什麼嗎?爲什麼在嘗試連接資源管理器後終止執行?

回答

0

我會建議取消從yarnsite.xml以下配置,因爲它們是不必要的:8088

<property> 
<name>yarn.resourcemanager.address</name> 
<value>localhost:8032</value> 
</property> 
<property> 
<name>yarn.resourcemanager.scheduler.address</name> 
<value>localhost:8030</value> 
</property> 
<property> 
<name>yarn.resourcemanager.resource-tracker.address</name> 
<value>localhost:8031</value> 
</property> 

您可以在本地主機訪問的資源管理器