我通過intellij運行spark工作。作業執行並給出輸出。我需要這份工作的jar文件到服務器並運行,但是當我嘗試做sbt assembly
它拋出以下錯誤:SBT裝配falis
[error] Not a valid command: assembly
[error] Not a valid project ID: assembly
[error] Expected ':' (if selecting a configuration)
[error] Not a valid key: assembly
[error] assembly
我SBT版本是0.13.8
是我build.sbt文件:
import sbt._, Keys._
name := "mobilewalla"
version := "1.0"
scalaVersion := "2.11.7"
libraryDependencies ++= Seq("org.apache.spark" %% "spark-core" % "2.0.0",
"org.apache.spark" %% "spark-sql" % "2.0.0")
我在項目目錄下添加了一個文件assembly.sbt。它包含:
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.3")
我在這裏
安裝sbt程序集後重新加載了嗎? –
是的,我做到了。是通過Build.sbt文件正確嗎?我需要添加任何東西嗎? – toofrellik
'sbt package'創建你的JAR文件以提交spark ... https://spark.apache.org/docs/2.0.0/quick-start.html#self-contained-applications –