MapReduce的Hadoop中2.2.0不工作

中安裝和僞分佈式模式配置的一切我Hadoop 2.2.0運行後，你可以在jps看到：MapReduce的Hadoop中2.2.0不工作

$ jps 
2287 JobHistoryServer 
1926 ResourceManager 
2162 NodeManager 
1834 DataNode 
1756 NameNode 
3013 Jps

然後我跑了

的wordcount的例子

hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount /user/hdfs/file /output

和執行frezees如下（？）：

$ hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount /user/hdfs/file /output           
OpenJDK 64-Bit Server VM warning: You have loaded library /home/hduser/hadoop-src/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. 
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. 
14/04/22 22:17:24 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
14/04/22 22:17:25 INFO client.RMProxy: Connecting to ResourceManager at /192.168.33.10:8032 
14/04/22 22:17:25 INFO input.FileInputFormat: Total input paths to process : 1 
14/04/22 22:17:25 INFO mapreduce.JobSubmitter: number of splits:1 
14/04/22 22:17:25 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class 
14/04/22 22:17:25 INFO Configuration.deprecation: mapreduce.combine.class is deprecated. Instead, use mapreduce.job.combine.class 
14/04/22 22:17:25 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name 
14/04/22 22:17:25 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class 
14/04/22 22:17:25 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir 
14/04/22 22:17:26 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1398204897594_0002 
14/04/22 22:17:26 INFO impl.YarnClientImpl: Submitted application application_1398204897594_0002 to ResourceManager at /192.168.33.10:8032 
14/04/22 22:17:26 INFO mapreduce.Job: The url to track the job: http://vagrant-ubuntu-saucy-64:8088/proxy/application_1398204897594_0002/ 
14/04/22 22:17:26 INFO mapreduce.Job: Running job: job_1398204897594_0002 
14/04/22 22:17:36 INFO mapreduce.Job: Job job_1398204897594_0002 running in uber mode : false 
14/04/22 22:17:36 INFO mapreduce.Job: map 0% reduce 0%

任何想法？

來源

2014-04-22 nanounanue

它似乎與http://stackoverflow.com/questions/18525354/map-reduce-job-getting-stuck-at-map-0-reduce-0 ，但建議的答案是「hadoop 1x」不適用於「hadoop 2.2.0」 – nanounanue

問題出在文件yarn-site.xml。該property必須大於3072 Mb大，我有它配置爲1024 Mb，所以正確的方法是

<property> 
    <name>yarn.nodemanager.resource.memory-mb</name> 
    <value>4096</value> 
    <description>Physical memory, in MB, to be made available to running containers</description> 
</property>

來源

2014-04-23 01:06:40 nanounanue

我說你增加了內存。但它仍然凍結我？ –

您可以請發佈該容器的用戶日誌嗎？ – karthik

我覺得不夠詳細日誌，你可以先打開調試模式：

export HADOOP_ROOT_LOGGER=DEBUG,console

然後運行wordcount工作查看更多日誌和粘貼

來源

2014-04-23 02:46:59 micmiu

MapReduce的Hadoop中2.2.0不工作

回答

相關問題