配置單元作業正在處理某個時間後停止

Question

我在獨立機器上運行配置單元。 Hadoop以僞分佈模式運行。我正在運行hive查詢哪些連接兩個表（一個表有7M，另一個有51M記錄，每個包含8列）。處理一段時間後，Mapper達到零百分比，然後偶爾繼續打印零點。你能幫我解決這個問題嗎？

僅供參考，請從以下的日誌中查找。

2016-04-12 22:52:58,469 Stage-1 map = 71%, reduce = 1% 
2016-04-12 22:53:00,517 Stage-1 map = 72%, reduce = 1% 
2016-04-12 22:53:02,560 Stage-1 map = 73%, reduce = 1% 
2016-04-12 22:53:09,740 Stage-1 map = 74%, reduce = 1% 
2016-04-12 22:53:11,796 Stage-1 map = 75%, reduce = 1% 
2016-04-12 22:53:13,842 Stage-1 map = 76%, reduce = 1% 
2016-04-12 22:53:21,037 Stage-1 map = 77%, reduce = 1% 
2016-04-12 22:53:24,114 Stage-1 map = 78%, reduce = 1% 
2016-04-12 22:53:26,156 Stage-1 map = 79%, reduce = 1% 
2016-04-12 22:53:35,433 Stage-1 map = 81%, reduce = 1% 
2016-04-12 22:53:38,507 Stage-1 map = 82%, reduce = 1% 
2016-04-12 22:53:45,725 Stage-1 map = 82%, reduce = 0% 
2016-04-12 22:53:49,925 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:54:50,236 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:55:50,546 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:56:50,863 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:57:51,128 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:58:51,352 Stage-1 map = 0%, reduce = 0% 
2016-04-12 22:59:51,612 Stage-1 map = 0%, reduce = 0% 
2016-04-12 23:00:51,886 Stage-1 map = 0%, reduce = 0% 
2016-04-12 23:01:52,131 Stage-1 map = 0%, reduce = 0% 

我驗證了跟蹤器中的狀態。狀態顯示兩次嘗試，一次嘗試失敗，診斷消息如下。

AM Container for appattempt_1460481465127_0001_000001 exited with exitCode: -100 
For more detailed output, check application tracking page:http://localhost:8088/cluster/app/application_1460481465127_0001Then, click on links to logs of each attempt. 
Diagnostics: Container released on a *lost* nodeFailing this attempt 

在此先感謝。

Answer 1

該問題似乎是由地圖側的堆空間引起的。
嘗試通過做增加了地圖任務堆大小以下：

在mapred-site.xml（嘗試調整下列值，以配合您的使用情況）：

<!-- for mappers --> 
<property> 
    <name>mapreduce.map.memory.mb</name> 
    <value>4096</value> 
</property> 
<!-- For reduces --> 
<property> 
    <name>mapreduce.reduce.memory.mb</name> 
    <value>8192</value> 
</property>