scala中未解析的xgboost庫依賴關係

我在庫和模塊中添加了我的xgboost jar文件。（如文檔中所述，我成功地從源代碼構建了這些jar文件）。我似乎無法解決它的依賴。我試圖用包含在構建sbt文件中的依賴項來運行它，並將其取出（因爲jar已經包含在庫和通過項目結構的依賴項中）。兩者似乎都失敗了。這是某種兼容性問題嗎？我正在運行scala 2.11.8和spark 2.1.0。我的依賴被包括在序列如下：scala中未解析的xgboost庫依賴關係

"ml.dmlc" %% "xgboost4j" % "0.7", "ml.dmlc" %% "xgboost4j-spark" % "0.7"

我似乎失去了一些東西，但我不知道是什麼。有任何想法嗎？

我嘗試發佈的jar的建議，但我得到了以下錯誤：

sbt.ResolveException: unresolved dependency: ml.dmlc#xgboost4j_2.11;0.7: not found 
unresolved dependency: ml.dmlc#xgboost4j-spark_2.11;0.7: not found 
     at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:313) 
     at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:191) 
     at sbt.IvyActions$$anonfun$updateEither$1.apply(IvyActions.scala:168) 
     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:156) 
     at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:156) 
     at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:133) 
     at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:57) 
     at sbt.IvySbt$$anon$4.call(Ivy.scala:65) 
     at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:93) 
     at xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:78) 
     at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:97) 
     at xsbt.boot.Using$.withResource(Using.scala:10) 
     at xsbt.boot.Using$.apply(Using.scala:9) 
     at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:58) 
     at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:48) 
     at xsbt.boot.Locks$.apply0(Locks.scala:31) 
     at xsbt.boot.Locks$.apply(Locks.scala:28) 
     at sbt.IvySbt.withDefaultLogger(Ivy.scala:65) 
     at sbt.IvySbt.withIvy(Ivy.scala:128) 
     at sbt.IvySbt.withIvy(Ivy.scala:125) 
     at sbt.IvySbt$Module.withModule(Ivy.scala:156) 
     at sbt.IvyActions$.updateEither(IvyActions.scala:168) 
     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1439) 
     at sbt.Classpaths$$anonfun$sbt$Classpaths$$work$1$1.apply(Defaults.scala:1435) 
     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$90.apply(Defaults.scala:1470) 
     at sbt.Classpaths$$anonfun$doWork$1$1$$anonfun$90.apply(Defaults.scala:1468) 
     at sbt.Tracked$$anonfun$lastOutput$1.apply(Tracked.scala:37) 
     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1473) 
     at sbt.Classpaths$$anonfun$doWork$1$1.apply(Defaults.scala:1467) 
     at sbt.Tracked$$anonfun$inputChanged$1.apply(Tracked.scala:60) 
     at sbt.Classpaths$.cachedUpdate(Defaults.scala:1490) 
     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1417) 
     at sbt.Classpaths$$anonfun$updateTask$1.apply(Defaults.scala:1369) 
     at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47) 
     at sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40) 
     at sbt.std.Transform$$anon$4.work(System.scala:63) 
     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) 
     at sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:228) 
     at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17) 
     at sbt.Execute.work(Execute.scala:237) 
     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) 
     at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:228) 
     at sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159) 
     at sbt.CompletionService$$anon$2.call(CompletionService.scala:28) 
     at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
     at java.util.concurrent.FutureTask.run(FutureTask.java:266) 
     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
     at java.lang.Thread.run(Thread.java:745) 
[error] (*:update) sbt.ResolveException: unresolved dependency: ml.dmlc#xgboost4j_2.11;0.7: not found 
[error] unresolved dependency: ml.dmlc#xgboost4j-spark_2.11;0.7: not found 
[error] Total time: 24 s, completed Aug 15, 2017 12:40:52 PM

來源

2017-08-15 Roshini

您可以從源代碼構建一個jar，並將其視爲非託管的依賴項，或者從maven中提取jar並將其視爲託管依賴項。 – erip

或者，您可以將xgboost的罐子發佈爲artifactory ...來製作原型，將它們發佈到您當地的ivy目錄。在sbt，'sbt publish-local'和maven中，'mvn install'（從xgboost目錄中）。這是您需要爲xgboost執行的操作。 – erip

@erip它必須被視爲一個非託管的依賴關係我猜想，因爲xgboost4j需要從源生成。我試圖從源代碼構建，但仍然不能真正解決依賴問題。我更新了問題！ – Roshini

的依賴應該只有一個％沒有。

"ml.dmlc" % "xgboost4j" % "0.7", "ml.dmlc" % "xgboost4j-spark" % "0.7"

來源

2017-08-15 13:49:17 Roshini

scala中未解析的xgboost庫依賴關係

回答

相關問題