1
調用Spark-submit
將導致默認的Ivy日誌顯示提取軟件包。雖然與第一次啓動相關,但通常緩存策略會使緩存命中記錄不那麼有用。當使用Spark-submit時禁用常春藤日誌記錄
禁用日誌的最佳方法是什麼?
不想看到的東西,如:
Ivy Default Cache set to: /root/.ivy2/cache
The jars for the packages stored in: /root/.ivy2/jars
:: loading settings :: url = jar:file:/usr/local/spark-2.0.2-bin-hadoop2.4/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
com.amazonaws#aws-java-sdk added as a dependency
org.apache.hadoop#hadoop-aws added as a dependency
...