HTTP/1.1 400錯誤請求正在執行oozie spark作業

Question

我正在嘗試對oozie_spark branch執行spark oozie example針對BigInsights for Apache Hadoop基本羣集。

的workflow.xml看起來是這樣的：

<workflow-app xmlns='uri:oozie:workflow:0.5' name='SparkWordCount'> 
<start to='spark-node' /> 
    <action name='spark-node'> 
    <spark xmlns="uri:oozie:spark-action:0.1"> 
    <job-tracker>${jobTracker}</job-tracker> 
    <name-node>${nameNode}</name-node> 
    <master>${master}</master> 
    <name>Spark-Wordcount</name> 
    <class>org.apache.spark.examples.WordCount</class> 
    <jar>/iop/apps/4.2.0.0/spark/jars/spark-assembly.jar,${jobDir}/lib/spark-wordcount-example.jar</jar> 
    <spark-opts>--conf spark.driver.extraJavaOptions=-Diop.version=4.2.0.0</spark-opts> 
    <arg>${inputDir}/FILE</arg> 
    <arg>${outputDir}</arg> 
    <capture-output/> 
    </spark> 
    <ok to="end" /> 
    <error to="fail" /> 
    </action> 
    <kill name="fail"> 
    <message>Workflow failed, error 
    message[${wf:errorMessage(wf:lastErrorNode())}] 
    </message> 
    </kill> 
<end name='end' /> 
</workflow-app> 

的configuration.xml中：

<configuration> 
    <property> 
     <name>master</name> 
     <value>local</value> 
    </property> 
    <property> 
     <name>queueName</name> 
     <value>default</value> 
    </property> 
    <property> 
     <name>user.name</name> 
     <value>default</value> 
    </property> 
    <property> 
     <name>nameNode</name> 
     <value>default</value> 
    </property> 
    <property> 
     <name>jobTracker</name> 
     <value>default</value> 
    </property> 
    <property> 
     <name>jobDir</name> 
     <value>/user/snowch/test</value> 
    </property> 
    <property> 
     <name>inputDir</name> 
     <value>/user/snowch/test/input</value> 
    </property> 
    <property> 
     <name>outputDir</name> 
     <value>/user/snowch/test/output</value> 
    </property> 
    <property> 
     <name>oozie.wf.application.path</name> 
     <value>/user/snowch/test</value> 
    </property> 
</configuration> 

但是，錯誤是：

Exception in thread "main" org.apache.hadoop.gateway.shell.HadoopException: 
    org.apache.hadoop.gateway.shell.ErrorResponse: HTTP/1.1 400 Bad Request 

我在做什麼錯？

Answer 1

該問題似乎是由於元素<capture-output/>。

我刪除了這個，錯誤消失了。