2017-08-03 236 views
1

我想使用hbase hortonworks連接器。 github guideHortonworks shc未解決的依賴關係

但我不知道如何將它導入到我的項目中。 我有以下build.sbt:

name := "project" 

version := "1.0" 

scalaVersion := "2.11.8" 

libraryDependencies ++= Seq(
    "org.apache.spark" % "spark-core_2.11" % "2.2.0", 
    "org.apache.spark" % "spark-sql_2.11" % "2.2.0", 
    "org.scala-lang" % "scala-compiler" % "2.11.8", 
    "com.hortonworks" % "shc" % "1.1.2-2.1-s_2.11-SNAPSHOT" 
) 

,這讓我的follwing未解決的依賴:

Error:Error while importing SBT project:
...
[warn] ==== local: tried [warn] ivy.xml [warn] ==== public: tried [warn]
https://repo1.maven.org/maven2/com/hortonworks/shc/1.1.2-2.1-s_2.11-SNAPSHOT/shc-1.1.2-2.1-s_2.11-SNAPSHOT.pom [info] Resolving jline#jline;2.12.1 ... [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] ::
UNRESOLVED DEPENDENCIES :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] [warn] Note: Unresolved dependencies path: [warn] com.hortonworks:shc:1.1.2-2.1-s_2.11-SNAPSHOT (build.sbt#L8-14) [warn] +- default:project_2.11:1.0 [trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for the full output. [trace] Stack trace suppressed: run 'last :update' for the full output. [error] (:ssExtractDependencies) sbt.ResolveException: unresolved dependency: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [error] (*:update) sbt.ResolveException: unresolved dependency: com.hortonworks#shc;1.1.2-2.1-s_2.11-SNAPSHOT: not found [error] Total time: 7 s, completed 3 août 2017 11:36:37

回答

0

我的建議是不要去使用Spark的最最新的版本,因爲所有的最新版本有一些錯誤需要修復。嘗試使用2.1.2火花版本,而不是2.2.0,並轉到maven存儲庫試試這個link

在這裏,你會得到火花的所有相關依賴關係。

0

在您的解決方案中,您需要添加代表存儲庫的resolvers行。

scalaVersion := "2.11.12" 

val sparkVersion = "2.1.0" 

resolvers += "Hortonworks Repository" at "http://repo.hortonworks.com/content/repositories/releases/" 

libraryDependencies += "org.apache.spark" %% "spark-core" % sparkVersion 
libraryDependencies += "org.apache.spark" %% "spark-sql" % sparkVersion 

libraryDependencies ++= Seq(
    "com.hortonworks" % "shc-core" % "1.1.1-2.1-s_2.11" 
)