2017-04-24 47 views
1

調用Spark-submit將導致默認的Ivy日誌顯示提取軟件包。雖然與第一次啓動相關,但通常緩存策略會使緩存命中記錄不那麼有用。當使用Spark-submit時禁用常春藤日誌記錄

禁用日誌的最佳方法是什麼?

不想看到的東西,如:

Ivy Default Cache set to: /root/.ivy2/cache 
The jars for the packages stored in: /root/.ivy2/jars 
:: loading settings :: url = jar:file:/usr/local/spark-2.0.2-bin-hadoop2.4/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml 
com.amazonaws#aws-java-sdk added as a dependency 
org.apache.hadoop#hadoop-aws added as a dependency 
... 

回答

0

嘗試增加這conf/log4j.properties禁用任何包org開始,其中包括Spark和常春藤所有的日誌記錄:

log4j.logger.org=OFF 

我還沒有嘗試過這一點,但我想這隻會禁用Ivy日誌記錄:

log4j.logger.org.apache.ivy=OFF