2016-07-31 104 views
4

我有以下build.sbt文件:傑克遜的版本太舊

name := "myProject" 

version := "1.0" 

scalaVersion := "2.11.8" 

javaOptions ++= Seq("-Xms512M", "-Xmx2048M", "-XX:MaxPermSize=2048M", "-XX:+CMSClassUnloadingEnabled") 


dependencyOverrides ++= Set(
    "com.fasterxml.jackson.core" % "jackson-core" % "2.8.1" 
) 

// additional libraries 
libraryDependencies ++= Seq(
    "org.apache.spark" %% "spark-core" % "2.0.0" % "provided", 
    "org.apache.spark" %% "spark-sql" % "2.0.0" % "provided", 
    "org.apache.spark" %% "spark-hive" % "2.0.0" % "provided", 
    "com.databricks" %% "spark-csv" % "1.4.0", 
    "org.scalactic" %% "scalactic" % "2.2.1", 
    "org.scalatest" %% "scalatest" % "2.2.1" % "test", 
    "org.scalacheck" %% "scalacheck" % "1.12.4", 
    "com.holdenkarau" %% "spark-testing-base" % "2.0.0_0.4.4" % "test", 
) 

然而,當我運行的代碼,我得到這個錯誤:

An exception or error caused a run to abort. 
java.lang.ExceptionInInitializerError 
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Jackson version is too old 2.4.4 
    at com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:56) 
    at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19) 
    at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:549) 
    at org.apache.spark.rdd.RDDOperationScope$.<init>(RDDOperationScope.scala:82) 
    at org.apache.spark.rdd.RDDOperationScope$.<clinit>(RDDOperationScope.scala) 
    ... 58 more 

爲什麼會出現這種情況? 我已將1個較新的版本添加到dependencyOverrides(在此處查看Spark Parallelize? (Could not find creator property with name 'id')之後),因此不應使用舊版本。

+0

它必須是別的東西,作爲一個依賴關係在舊版本中拉動。你需要找到那是什麼,並得到一個與傑克遜最新的版本。 Maven會很容易弄清楚。 – duffymo

+0

嘗試在'libraryDependencies'中加上'force()'來添加jackson依賴項:'libraryDependencies ++ = Seq(...「com.fasterxml.jackson.core」%「jackson-core」%「2.8.1 「force()' –

回答

3

傑克遜核心和jackson-databind版本應該匹配(至少達到小版本,我相信)。

所以去除dependencyOverrides並有

libraryDependencies ++= Seq(
    ... 
    "com.fasterxml.jackson.core" % "jackson-databind" % "2.8.1" 
) 

或者在dependencyOverrides

dependencyOverrides ++= Set(
    "com.fasterxml.jackson.core" % "jackson-core" % "2.8.1" 
    "com.fasterxml.jackson.core" % "jackson-databind" % "2.8.1" 
) 

同時指定雖然我不知道我明白你正在嘗試做的;鏈接的問題似乎說你應該使用舊版本(2.4.4)。