星火：抗連接兩個DStreams

Question

我可以執行連接兩個星火DStreams像：

val joinStream = stream1.join(stream2) 

現在，如果我需要過濾掉所有未加入的記錄。基本上，就像stream1.anti-join(stream2)。這可能以某種方式嗎？

謝謝，感謝任何幫助！

Answer 1

假如你想知道這些：

val rdd1 = sc.parallelize(Array(
    (1, "one"), 
    (2, "twow"), 
    (3, "three"), 
    (4, "four"), 
    (5, "five") 
)) 
val rdd2 = sc.parallelize(Array(
    (1, "otherOne"), 
    (4, "otherFour"), 
    (5,"otherFive"), 
    (6,"six"), 
    (7,"seven") 
)) 

val antiJoined = rdd1.fullOuterJoin(rdd2).filter(r => r._2._1.isEmpty || r._2._2.isEmpty) 

antiJoined.collect foreach println 
(6,(None,Some(six))) 
(2,(Some(twow),None)) 
(3,(Some(three),None)) 
(7,(None,Some(seven)))