2
我是Hadoop的新手,想了解安裝時附帶的jar文件。你可以用hadoop-mapreduce-examples-2.2.0.jar做什麼?
我一直在使用hadoop-mapreduce-examples-2.2.0.jar來運行wordcount測試。事情進展順利,但我想知道除了wordcount之外,我還可以用這個jar文件或其他jar文件來做些什麼?
我是Hadoop的新手,想了解安裝時附帶的jar文件。你可以用hadoop-mapreduce-examples-2.2.0.jar做什麼?
我一直在使用hadoop-mapreduce-examples-2.2.0.jar來運行wordcount測試。事情進展順利,但我想知道除了wordcount之外,我還可以用這個jar文件或其他jar文件來做些什麼?
您可以通過運行看例子程序列表:
hadoop jar /path/to/hadoop-mapreduce-examples-2.2.0.jar
我的輸出:
Valid program names are:
aggregatewordcount: An Aggregate based map/reduce program that counts the words in the input files.
aggregatewordhist: An Aggregate based map/reduce program that computes the histogram of the words in the input files.
dbcount: An example job that count the pageview counts from a database.
grep: A map/reduce program that counts the matches of a regex in the input.
join: A job that effects a join over sorted, equally partitioned datasets
multifilewc: A job that counts words from several files.
pentomino: A map/reduce tile laying program to find solutions to pentomino problems.
pi: A map/reduce program that estimates Pi using monte-carlo method.
randomtextwriter: A map/reduce program that writes 10GB of random textual data per node.
randomwriter: A map/reduce program that writes 10GB of random data per node.
secondarysort: An example defining a secondary sort to the reduce.
sleep: A job that sleeps at each map and reduce task.
sort: A map/reduce program that sorts the data written by the random writer.
sudoku: A sudoku solver.
teragen: Generate data for the terasort
terasort: Run the terasort
teravalidate: Checking results of terasort
wordcount: A map/reduce program that counts the words in the input files.
真棒!謝謝傑里米! – user3311268
@Jeremy Beard:在哪裏可以獲得這些程序的完整信息(如代碼,運行前所需的參數_wordcount_ _path/to/input_ _path/to/output_) –
只有在添加到conf/hadoop-env.sh :export HADOOP_CLASSPATH = $ HADOOP_CLASSPATH:$ HADOOP_MAPRED_HOME:$ HADOOP_HDFS_HOME:$ HADOOP_YARN_HOME:$ HADOOP_HOME:$ HADOOP_CONF_DIR:$ YARN_CONF_DIR:$ JSVC_HOME – alex