1
我使用Cloudera VM(cdh3u2)作爲模擬分佈式文件系統。爲了執行文件創建和從Web服務器寫入,我將fs.http.address屬性更改爲指向VM IP。此功能正常工作。 問題出現時HIVE執行地圖縮小像cloudera vm hadoop Hive在fs.http.address ip變更後失敗
SELECT COUNT(*) FROM tmp2;
的消息我得到的工作是:
hive> select count(*) from tmp2;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapred.reduce.tasks=<number>
Starting Job = job_201111301538_0001, Tracking URL = http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201111301538_0001
Kill Command = /usr/lib/hadoop/bin/hadoop job -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201111301538_0001
2011-11-30 16:01:21,773 Stage-1 map = 0%, reduce = 0%
2011-11-30 16:01:43,064 Stage-1 map = 100%, reduce = 100%
Ended Job = job_201111301538_0001 with errors
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
蜂巢執行下面的SQL(不需要映射精簡工作),沒有問題:
SHOW TABLES;
SELECT * FROM tmp2;