SBT中Spark-Streaming和Twiter-Streaming的依賴關係

Question

我試圖在build.sbt中使用以下依賴項，但它一直給出「未解決的依賴性」問題。

libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter_2.11" % "2.2.0.1.0.0-SNAPSHOT" 
libraryDependencies += "org.apache.spark" %% "spark-streaming" % "2.2.0" 

我正在使用Spark 2.2.0。什麼是正確的依賴關係？

Answer 1

下面是您需要爲Spark-Twitter Streaming添加的依賴關係。

<dependency> 
    <groupId>org.apache.spark</groupId> 
    <artifactId>spark-streaming_2.11</artifactId> 
    <version>2.0.0</version> 
</dependency> 
<dependency> 
    <groupId>org.apache.bahir</groupId> 
    <artifactId>spark-streaming-twitter_2.11</artifactId> 
    <version>2.0.0</version> 
</dependency> 
<dependency> 
    <groupId>org.twitter4j</groupId> 
    <artifactId>twitter4j-core</artifactId> 
    <version>4.0.4</version> 
    </dependency> 
<dependency> 
    <groupId>org.twitter4j</groupId> 
    <artifactId>twitter4j-stream</artifactId> 
    <version>4.0.4</version> 
    </dependency > 
<dependency> 
    <groupId>com.twitter</groupId> 
    <artifactId>jsr166e</artifactId> 
    <version>1.1.0</version> 
</dependency>