2013-12-22 62 views
5

我一直在使用本教程一臺機器上安裝Hadoop的2.2:http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/Hadoop的 HDFS:「沒有這樣的文件或目錄」

一些細節改變了一點點 - 比如,我用java 8/Hadoop的根目錄等。用戶,SSH,配置密鑰 - 相同。

的Namenode是成功格式化:

13/12/22 05:42:31 INFO common.Storage: Storage directory /hadoop/tmp/dfs/name has been successfully formatted. 
13/12/22 05:42:31 INFO namenode.FSImage: Saving image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression 
13/12/22 05:42:32 INFO namenode.FSImage: Image file /hadoop/tmp/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 198 bytes saved in 0 seconds. 
13/12/22 05:42:32 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0 
13/12/22 05:42:32 INFO util.ExitUtil: Exiting with status 0 
13/12/22 05:42:32 INFO namenode.NameNode: SHUTDOWN_MSG: 

然而,並不是 '的mkdir' 既不甚至 'ls' 的命令工作:

$ /hadoop/hadoop/bin/hadoop fs -ls 
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /hadoop/hadoop-2.2.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. 
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'. 
13/12/22 05:39:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 
ls: `.': No such file or directory 

感謝您的幫助球員。

+0

更新:**/hadoop/hadoop/bin/hadoop fsck -move **打印_路徑'/'下的文件系統是HEALTHY_ – Spaceman

+0

'ls:'。':沒有這樣的文件或目錄可能意味着你什麼都沒有文件或文件夾)在hdfs中。你提到'hadoop fs -mkdir'不能正常工作,錯誤是什麼?你有沒有試過'hadoop fs -mkdir/tmp'? – zhutoulala

+0

@zhutoulala太晚了=)我轉而使用Disco MR框架,我對此非常滿意...... Hadoop感覺像是我曾經使用的用戶最不友好的工具之一。 「Java風格」,是的。 – Spaceman

回答

11

在Hadoop的2.4

hdfs dfs -mkdir /input 
hdfs dfs -ls/
2

我已經證實了這項工作中的Hadoop 2.5

hdfs dfs -mkdir /input 

(其中/input爲t他HDFS目錄)

2

曾在我的情況: 首先通過獲取Hadoop的安裝路徑:

echo ${HADOOP_INSTALL} //in my case output is : `/user/local/hadoop` 

然後在你的Hadoop安裝路徑創建目錄,如果你知道你的Hadoop的安裝目錄中忽略上面的命令

hadoop fs -mkdir -p /user/local/hadoop/your_directory 

這裏Hadoop是目錄

測試Hadoop的2.4

相關問題