我一直在使用本教程一臺機器上安裝Hadoop的2.2:http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/Hadoop的 HDFS:「沒有這樣的文件或目錄」
一些細節改變了一點點 - 比如,我用java 8/Hadoop的根目錄等。用戶,SSH,配置密鑰 - 相同。
的Namenode是成功格式化:
13/12/22 05:42:31 INFO common.Storage: Storage directory /hadoop/tmp/dfs/name has been successfully formatted.
13/12/22 05:42:31 INFO namenode.FSImage: Saving image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression
13/12/22 05:42:32 INFO namenode.FSImage: Image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 198 bytes saved in 0 seconds.
13/12/22 05:42:32 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
13/12/22 05:42:32 INFO util.ExitUtil: Exiting with status 0
13/12/22 05:42:32 INFO namenode.NameNode: SHUTDOWN_MSG:
然而,並不是 '的mkdir' 既不甚至 'ls' 的命令工作:
$ /hadoop/hadoop/bin/hadoop fs -ls
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /hadoop/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
13/12/22 05:39:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `.': No such file or directory
感謝您的幫助球員。
更新:**/hadoop/hadoop/bin/hadoop fsck -move **打印_路徑'/'下的文件系統是HEALTHY_ – Spaceman
'ls:'。':沒有這樣的文件或目錄可能意味着你什麼都沒有文件或文件夾)在hdfs中。你提到'hadoop fs -mkdir'不能正常工作,錯誤是什麼?你有沒有試過'hadoop fs -mkdir/tmp'? – zhutoulala
@zhutoulala太晚了=)我轉而使用Disco MR框架,我對此非常滿意...... Hadoop感覺像是我曾經使用的用戶最不友好的工具之一。 「Java風格」,是的。 – Spaceman