我正在嘗試向hadoop源代碼添加一個小的LOG.info語句,具體是hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app。目前,我從二進制文件夾中運行的Hadoop:修改MapReduce AppMaster源不起作用
$ ls /hadoop/share/hadoop/
common hdfs httpfs kms mapreduce tools yarn
我也有Hadoop的源文件夾:
$ ls /hadoop-source/
BUILDING.txt hadoop-hdfs-project hadoop-tools
dev-support hadoop-mapreduce-project hadoop-yarn-project
hadoop-assemblies hadoop-maven-plugins LICENSE.txt
hadoop-client hadoop-minicluster NOTICE.txt
hadoop-common-project hadoop-project pom.xml
hadoop-dist hadoop-project-dist README.txt
我修改的Hadoop源Hadoop的源文件夾內,然後編譯生成基於Maven罐子。之後,我從我的/ hadoop/share/hadoop/mapreduce中刪除特定的jar,並從hadoop-source中添加一個新的jar。
但是,我用簡單的mapreduce程序運行hadoop後,我無法在MRAppMaster日誌中看到新添加的LOG.info語句。我也嘗試刪除hadoop-mapreduce-client-app-2.6.0.jar。但是hadoop仍然可以執行mapreduce作業。我也檢查了類路徑,它指向刪除jar所在的文件夾。如果你能解釋爲什麼會發生這種情況,請做。
的Hadoop版本:2.6.0 Java版本:1.7.0_101
是的,jar在所有節點上。 –