火花提交的NoSuchMethodError BigDecimalDeserializer

-1

我有使用Htable類的HBase的Scala代碼，我建立，作爲罐子和使用運行火花提交類似下面火花提交的NoSuchMethodError BigDecimalDeserializer

spark2-submit --conf spark.driver.extraClassPath=/opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/lib/hbase/lib/* --class commontest scala-maven-plugin-0.0.1-SNAPSHOT.jar

我傳遞使用extraClassPath HBase的類路徑，但仍然低於錯誤，有沒有人得到這個錯誤？

Exception in thread "main" java.lang.NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer$.handledType()Ljava/lang/Class; 
at com.fasterxml.jackson.module.scala.deser.NumberDeserializers$.<init>(ScalaNumberDeserializersModule.scala:49) 
at com.fasterxml.jackson.module.scala.deser.NumberDeserializers$.<clinit>(ScalaNumberDeserializersModule.scala) 
at com.fasterxml.jackson.module.scala.deser.ScalaNumberDeserializersModule$class.$init$(ScalaNumberDeserializersModule.scala:61) 
at com.fasterxml.jackson.module.scala.DefaultScalaModule.<init>(DefaultScalaModule.scala:20) 
at com.fasterxml.jackson.module.scala.DefaultScalaModule$.<init>(DefaultScalaModule.scala:37) 
at com.fasterxml.jackson.module.scala.DefaultScalaModule$.<clinit>(DefaultScalaModule.scala) 
at org.apache.spark.util.JsonProtocol$.<init>(JsonProtocol.scala:59) 
at org.apache.spark.util.JsonProtocol$.<clinit>(JsonProtocol.scala) 
at org.apache.spark.scheduler.EventLoggingListener$.initEventLog(EventLoggingListener.scala:270) 
at org.apache.spark.scheduler.EventLoggingListener.start(EventLoggingListener.scala:121) 
at org.apache.spark.SparkContext.<init>(SparkContext.scala:531) 
at KPICommonDeviceDayUsage$.main(KPICommonDeviceDayUsage.scala:339) 
at KPICommonDeviceDayUsage.main(KPICommonDeviceDayUsage.scala) 
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
at java.lang.reflect.Method.invoke(Method.java:606) 
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738) 
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187) 
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212) 
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126) 
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

來源

2017-10-04 user3607698

Exception in thread "main" java.lang.NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer$.handledType()Ljava/lang/Class;

此異常指示你可以在運行時庫的多個版本。

來源

2017-10-04 15:49:08

如何知道在哪裏添加了多個版本的相同庫或強制只包含一個版本的庫 – user3607698

火花提交的NoSuchMethodError BigDecimalDeserializer

回答

相關問題