cloudera中配置單元查詢的問題

我可以在配置單元中執行所有其他查詢，但是當我進行連接時，它會卡住。cloudera中配置單元查詢的問題

hive> select count (*) from tab10 join tab1; 
Warning: Map Join MAPJOIN[13][bigTable=tab10] in task 'Stage-2:MAPRED' is a cross product 
Query ID = root_20160406145959_b57642e0-7499-41a0-914c-0004774fe4ac 
Total jobs = 1 
Execution log at: /tmp/root/root_20160406145959_b57642e0-7499-41a0-914c-0004774fe4ac.log 
2016-04-06 03:00:03 Starting to launch local task to process map join; maximum memory = 2058354688 

2016-04-06 03:00:03 Dump the side-table for tag: 1 with group count: 1 into file: file:/tmp/root/b71aa45b-f356-4a54-a880-77e57cd53ed3/hive_2016-04-06_14-59-59_858_3722397802100174236-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile01--.hashtable 
2016-04-06 03:00:03 Uploaded 1 File to: file:/tmp/root/b71aa45b-f356-4a54-a880-77e57cd53ed3/hive_2016-04-06_14-59-59_858_3722397802100174236-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile01--.hashtable (280 bytes) 
2016-04-06 03:00:03 End of local task; Time Taken: 0.562 sec.

它掛在這一點上，它並沒有產生任何地圖縮小任務。什麼可能是錯的？

我在hive.log中看到了這個。

2016-04-06 15:00:00,124 INFO [main]: ql.Driver (Driver.java:launchTask(1643)) - Starting task [Stage-5:MAPREDLOCAL] in serial mode 
2016-04-06 15:00:00,125 INFO [main]: mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating plan file file:/tmp/root/b71aa45b-f356-4a54-a880-77e57cd53ed3/hive_2016-04-06_14-59-59_858_3722397802100174236-1/-local-10006/plan.xml 
2016-04-06 15:00:00,233 INFO [main]: mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: /opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/lib/hadoop/bin/hadoop jar /opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/jars/hive-exec-1.1.0-cdh5.5.2.jar org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan file:/tmp/root/b71aa45b-f356-4a54-a880-77e57cd53ed3/hive_2016-04-06_14-59-59_858_3722397802100174236-1/-local-10006/plan.xml -jobconffile file:/tmp/root/b71aa45b-f356-4a54-a880-77e57cd53ed3/hive_2016-04-06_14-59-59_858_3722397802100174236-1/-local-10007/jobconf.xml

除此之外沒有什麼。任何人都知道如何解決此問題？

來源

2016-04-06 Pradeep Nayak

請張貼查詢你的例子運行中產生交叉產品錯誤。 – Jared

[hive版本0.13.1中的性能問題]的可能重複（http://stackoverflow.com/questions/27900760/performance-issue-in-hive-version-0-13-1） – Jared

開放mapred-site.xml文件並添加屬性：

<property> 
<name>mapred.child.java.opts</name> 
<value>-Xmx1024m</value>

你需要增加Hadoop的JVM使用的堆內存

來源

2016-04-08 13:51:40 TKHN

cloudera中配置單元查詢的問題

回答

相關問題