hadoop在屏幕上的日誌太多

Question

我最近開始學習使用hive的hadoop。作爲初學者，我不太熟悉屏幕上顯示的所有日誌。所以最好看到所有重要日誌的乾淨版本。我學習基於Rutberglen的「Programming Hive」書的配置單元。

剛開始，我在第一條命令後得到了大量的日誌。在書上，它只是「好的，花費的時間：3.543秒」。

任何人都有解決方案來減少這些日誌？

PS：以下是我從命令「create table x (a int);」得到了日誌

WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. 
Sep 28, 2014 12:10:28 AM org.apache.hadoop.hive.conf.HiveConf <clinit> 
WARNING: hive-site.xml not found on CLASSPATH 
Logging initialized using configuration in jar:file:/Users/admin/Documents/Study/software /Programming/Hive/hive-0.9.0-bin/lib/hive-common-0.9.0.jar!/hive-log4j.properties 
Sep 28, 2014 12:10:28 AM SessionState printInfo 
INFO: Logging initialized using configuration in jar:file:/Users/admin/Documents/Study/software/Programming/Hive/hive-0.9.0-bin/lib/hive-common-0.9.0.jar!/hive-log4j.properties 
Hive history file=/tmp/admin/hive_job_log_admin_201409280010_720612579.txt 
Sep 28, 2014 12:10:28 AM hive.ql.exec.HiveHistory printInfo 
INFO: Hive history file=/tmp/admin/hive_job_log_admin_201409280010_720612579.txt 
hive> CREATE TABLE x (a INT); 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver PerfLogBegin 
INFO: <PERFLOG method=Driver.run> 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver PerfLogBegin 
INFO: <PERFLOG method=compile> 
Sep 28, 2014 12:10:31 AM hive.ql.parse.ParseDriver parse 
INFO: Parsing command: CREATE TABLE x (a INT) 
Sep 28, 2014 12:10:31 AM hive.ql.parse.ParseDriver parse 
INFO: Parse Completed 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.parse.SemanticAnalyzer analyzeInternal 
INFO: Starting Semantic Analysis 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.parse.SemanticAnalyzer analyzeCreateTable 
INFO: Creating table x position=13 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver compile 
INFO: Semantic Analysis Completed 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver getSchema 
INFO: Returning Hive schema: Schema(fieldSchemas:null, properties:null) 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver PerfLogEnd 
INFO: </PERFLOG method=compile start=1411877431127 end=1411877431388 duration=261> 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver PerfLogBegin 
INFO: <PERFLOG method=Driver.execute> 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.ql.Driver execute 
INFO: Starting command: CREATE TABLE x (a INT) 
Sep 28, 2014 12:10:31 AM hive.ql.exec.DDLTask createTable 
INFO: Default to LazySimpleSerDe for table x 
Sep 28, 2014 12:10:31 AM hive.log getDDLFromFieldSchema 
INFO: DDL: struct x { i32 a} 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.metastore.HiveMetaStore newRawStore 
INFO: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 
Sep 28, 2014 12:10:31 AM org.apache.hadoop.hive.metastore.ObjectStore initialize 
INFO: ObjectStore, initialize called 
Sep 28, 2014 12:10:32 AM org.apache.hadoop.hive.metastore.ObjectStore getPMF 
INFO: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 
Sep 28, 2014 12:10:32 AM org.apache.hadoop.hive.metastore.ObjectStore setConf 
INFO: Initialized ObjectStore 
Sep 28, 2014 12:10:33 AM org.apache.hadoop.hive.metastore.HiveMetaStore logInfo 
INFO: 0: create_table: db=default tbl=x 
Sep 28, 2014 12:10:34 AM org.apache.hadoop.hive.ql.Driver PerfLogEnd 
INFO: </PERFLOG method=Driver.execute start=1411877431389 end=1411877434527 duration=3138> 
OK 
Sep 28, 2014 12:10:34 AM org.apache.hadoop.hive.ql.Driver printInfo 
INFO: OK 
Sep 28, 2014 12:10:34 AM org.apache.hadoop.hive.ql.Driver PerfLogBegin 
INFO: <PERFLOG method=releaseLocks> 
Sep 28, 2014 12:10:34 AM org.apache.hadoop.hive.ql.Driver PerfLogEnd 
INFO: </PERFLOG method=releaseLocks start=1411877434529 end=1411877434529 duration=0> 
Sep 28, 2014 12:10:34 AM org.apache.hadoop.hive.ql.Driver PerfLogEnd 
INFO: </PERFLOG method=Driver.run start=1411877431126 end=1411877434530 duration=3404> 
Time taken: 3.407 seconds 
Sep 28, 2014 12:10:34 AM CliDriver printInfo 
INFO: Time taken: 3.407 seconds 

Answer 1

開始嘗試蜂巢外殼如下：

hive --hiveconf hive.root.logger=WARN,console 

如果你想使這個變化執着，修改記錄屬性文件HIVE_CONF_DIR/hive-log4j.properties文件。如果您的HIVE_CONF_DIR中沒有此文件，請通過複製HIVE_CONF_DIR中的hive-log4j.default的內容來創建此文件。