2015-09-15 40 views
0

我使用Hue訪問Hive服務。我創建了一個使用Hive表格Cloudera ToolRunner

create table tablename(colname type,.....) 
row format delimited fields terminated by ','; 

I上傳了300 000條記錄的數據。但是,在執行類似的查詢:

select count(*) from tablename; 

它正在創建MapReduce工作,並在這個時候,我得到以下警告,如何解決此警告。

警告:未執行Hadoop命令行選項解析。執行 Tool接口並使用ToolRunner執行您的應用程序到 補救此問題。

完整的日誌:

INFO : Number of reduce tasks determined at compile time: 1 
INFO : In order to change the average load for a reducer (in bytes): 
INFO : set hive.exec.reducers.bytes.per.reducer=<number> 
INFO : In order to limit the maximum number of reducers: 
INFO : set hive.exec.reducers.max=<number> 
INFO : In order to set a constant number of reducers: 
INFO : set mapreduce.job.reduces=<number> 
WARN : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 
INFO : number of splits:1 
INFO : Submitting tokens for job: job_1442315442114_0017 
INFO : The url to track the job: http://dwiclmaster:8088/proxy/application_1442315442114_0017/ 
INFO : Starting Job = job_1442315442114_0017, Tracking URL = http://dwiclmaster:8088/proxy/application_1442315442114_0017/ 
INFO : Kill Command = /opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/lib/hadoop/bin/hadoop job -kill job_1442315442114_0017 
INFO : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1 
INFO : 2015-09-15 18:29:06,910 Stage-1 map = 0%, reduce = 0% 
INFO : 2015-09-15 18:29:15,257 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.65 sec 
INFO : 2015-09-15 18:29:21,513 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.19 sec 
INFO : MapReduce Total cumulative CPU time: 3 seconds 190 msec 
INFO : Ended Job = job_1442315442114_0017 

回答

0

這是剛剛從MapReduce的上來提交的蜂房不實現接口的工作警告。這可以安全地忽略。

更多關於Tool Runner