MongoDB hadoop連接器無法在mongo hive表上查詢

Question

我正在使用MongoDB hadoop連接器在hadoop中使用hive表查詢mongoDB。

我能夠執行

select * from mongoDBTestHiveTable; 

但是，當我嘗試執行下面的查詢

select id from mongoDBTestHiveTable; 

它拋出異常以下。

下面的類存在於hive lib文件夾中。

異常堆棧跟蹤：

Diagnostic Messages for this Task: 
Error: java.io.IOException: Cannot create an instance of InputSplit class = com.mongodb.hadoop.hive.input.HiveMongoInputFormat$MongoHiveInputSplit:Class com.mongodb.hadoop.hive.input.HiveMongoInputFormat$MongoHiveInputSplit not found 
    at org.apache.hadoop.hive.ql.io.HiveInputFormat$HiveInputSplit.readFields(HiveInputFormat.java:147) 
    at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71) 
    at org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42) 
    at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:370) 
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:402) 
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) 
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162) 
    at java.security.AccessController.doPrivileged(Native Method) 
    at javax.security.auth.Subject.doAs(Subject.java:415) 
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) 
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157) 
Caused by: java.lang.ClassNotFoundException: Class com.mongodb.hadoop.hive.input.HiveMongoInputFormat$MongoHiveInputSplit not found 
    at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1626) 
    at org.apache.hadoop.hive.ql.io.HiveInputFormat$HiveInputSplit.readFields(HiveInputFormat.java:144) 
    ... 10 more 

Container killed by the ApplicationMaster. 

請指點。

Answer 1

您還需要蒙戈 - hadoop- *和以及蒙戈驅動程序jar添加到MR1/MR2類路徑上的所有工人