蜂巢表創建，但地圖的任務與例外

我創建了一個鳴叫表蜂房（蜂房0.10.0上CDH 4.6），堅持了以下錯誤時嘗試執行查詢失敗蜂巢表創建，但地圖的任務與例外

hive> select * from tweets where id='442990122795929600'; 
Total MapReduce jobs = 1 
Launching Job 1 out of 1 
Number of reduce tasks is set to 0 since there's no reduce operator 
Starting Job = job_201404071250_0010, Tracking URL = http://swapnil:50030/jobdetails.jsp?jobid=job_201404071250_0010 
Kill Command = /usr/lib/hadoop/bin/hadoop job -kill job_201404071250_0010 
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 0 
2014-04-08 00:45:24,755 Stage-1 map = 0%, reduce = 0% 
2014-04-08 00:46:25,892 Stage-1 map = 0%, reduce = 0% 
2014-04-08 00:47:06,691 Stage-1 map = 100%, reduce = 100% 
Ended Job = job_201404071250_0010 with errors 
Error during job, obtaining debugging information... 
Job Tracking URL: http://swapnil:50030/jobdetails.jsp?jobid=job_201404071250_0010 
Examining task ID: task_201404071250_0010_m_000002 (and more) from job job_201404071250_0010 

Task with the most failures(4): 
----- 
Task ID: 
    task_201404071250_0010_m_000000 

URL: 
    http://swapnil:50030/taskdetails.jsp?jobid=job_201404071250_0010&tipid=task_201404071250_0010_m_000000 
----- 
Diagnostic Messages for this Task: 
java.lang.RuntimeException: Error in configuring object 
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) 
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75) 
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133) 
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413) 
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332) 
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at javax.security.auth.Subject.doAs(Subject.java:416) 
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438) 
    at org.apache.hadoop.mapred.Child.main(Child.java:262) 
Caused by: java.lang.reflect.InvocationTargetException 
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja 

FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask 
MapReduce Jobs Launched: 
Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL 
Total MapReduce CPU Time Spent: 0 msec

我嘗試將jar「hive-contrib-0.10.0-cdh4.6.0.jar」添加到classpath中，但沒有運氣。

任何人都可以幫助解決這個問題嗎？

來源

2014-04-07 swapnils10

你正在處理什麼樣的數據？它是JSON/AVRO文件還是純文本文件？ –

我正在處理twitter的JSON數據 – swapnils10

可能是您的數據和模式不匹配。你可以分享你的配置單元表架構和JSON數據文件嗎？你還在使用哪個JSON Serde？ –

HIVE-SITE.XML不在類路徑中，配置單元指的是hive-default.xml。由此，配置單元的Metastore服務沒有運行。

修改Hadoop和配置單元的環境配置文件參照

hive-site.xml not found on classpath

來源

2014-04-15 09:59:25 swapnils10

你能在HIVE檢查hive.exec.max.created.files變量 - 當你Map/Reducer創建的文件的數量超過了max文件100000（默認值） - 它殺死了這個工作同時檢查你的hive.log以獲得更多關於你的問題的信息。

來源

2016-02-29 07:26:32 Lakshmana

蜂巢表創建，但地圖的任務與例外

回答

相關問題