從多個文件讀取多個CSV文件到熊貓DataFrame

Question

我想通過包含在同一目錄中不同文件夾中的不同csv文件。我的文件夾位於我的工作目錄中。我的文件夾命名爲：

folder1, folder2,folder3 

他們每個人都有CSV的具有相同名稱csv1.csv, csv2.csv。

我試過這段代碼：

import os 
import re 
import pandas as pd 
from pandas.core.frame import DataFrame 

rootDir = '.' 
for dirName, subdirList, fileList in os.walk(rootDir, topdown=False): 
    print('Found directory: %s' % dirName) 
    for fname in fileList: 
     print('\t%s' % fname) 

     if "csv1.csv" == fname: 
      var= pd.read_csv(fname) 

我可以打印文件夾中的CSV文件的名字，但我得到一個錯誤： IOError: File csv1.csv does not exist
可能是什麼問題呢？

Answer 1

正如你可以在評論中看到的，你必須加入rootDir，dirName和fname。

import os 
import re 
import pandas as pd 
from pandas.core.frame import DataFrame 

rootDir = '.' 
for dirName, subdirList, fileList in os.walk(rootDir, topdown=False): 
    print('Found directory: %s' % dirName) 
    for fname in fileList: 
     print('\t%s' % fname) 
     filepath = os.path.join(rootDir, dirName, fname) 
     if "csv1.csv" == fname: 
      var = pd.read_csv(filepath) 
      print var.head() 

os.path.join(path, *paths)：

Join one or more path components intelligently. The return value is the concatenation of path and any members of *paths with exactly one directory separator (os.sep) following each non-empty part except the last, meaning that the result will only end in a separator if the last part is empty. If a component is an absolute path, all previous components are thrown away and joining continues from the absolute path component.

On Windows, the drive letter is not reset when an absolute path component (e.g., r'\foo') is encountered. If a component contains a drive letter, all previous components are thrown away and the drive letter is reset. Note that since there is a current directory for each drive, os.path.join("c:", "foo") represents a path relative to the current directory on drive C: (c:foo), not c:\foo .