2017-08-10 44 views
1

我在這裏是新的....很抱歉,如果我問天真的問題!在SparkR中創建數據幀?

我在Rstudio中使用SparkR。

[R版本3.3.2 星火版本2.0.2

我能夠R中的工作室成功啓動Spark和我可以看到使用Web用戶界面。本地主機:4040,我的火花正在運行。

但是,一旦我嘗試創建數據幀提示錯誤是這樣的:

Error in invokeJava(isStatic = FALSE, objId$id, methodName, ...) : 
    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1, localhost): java.lang.NullPointerException 
    at java.lang.ProcessBuilder.start(Unknown Source) 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:482) 
    at org.apache.hadoop.util.Shell.run(Shell.java:455) 
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) 
    at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:873) 
    at org.apache.hadoop.fs.FileUtil.chmod(FileUtil.java:853) 
    at org.apache.spark.util.Utils$.fetchFile(Utils.scala:474) 
    at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:488) 
    at org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:480) 
    at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:7 

任何人可以幫我這個....在此先感謝:)

+0

也許這個以前的問題可以幫助你:https://stackoverflow.com/questions/38863003/sparkr-from-rstudio-gives-error-in-invokejavaisstatic-true-classname-meth – Shaido

+1

當你使用sparkR,你可以無法使用正常的數據幀。你需要使用SparkDataFrame,你可以檢查這個https://spark.apache.org/docs/latest/sparkr.html#sparkdataframe –

回答