2017-02-17 59 views
0

我使用pandas read_csv來讀取一個簡單的csv文件。但是,它有ValueError: could not convert string to float:,我不明白爲什麼。python pandas read_csv千位分隔符不起作用

的代碼只是

rawdata = pd.read_csv(r'Journal_input.csv' , 
         dtype = { 'Base Amount' : 'float64' } , 
         thousands = ',' , 
         decimal = '.', 
         encoding = 'ISO-8859-1') 

但我得到這個錯誤

pandas\parser.pyx in pandas.parser.TextReader.read (pandas\parser.c:10415)()

pandas\parser.pyx in pandas.parser.TextReader._read_low_memory (pandas\parser.c:10691)()

pandas\parser.pyx in pandas.parser.TextReader._read_rows (pandas\parser.c:11728)()

pandas\parser.pyx in pandas.parser.TextReader._convert_column_data (pandas\parser.c:13162)()

pandas\parser.pyx in pandas.parser.TextReader._convert_tokens (pandas\parser.c:14487)()

ValueError: could not convert string to float: '79,026,695.50'

如何轉換的79年,026,695.50' 浮動字符串時有可能得到錯誤?我已經指定了這兩個選項

thousands = ',' , 
decimal = '.', 

這是我們的代碼或熊貓中的一個錯誤嗎?

+0

你可以添加文件的內容質疑?或者更好地上傳文件到gdocs,dropbox ..如果數據不確定? – jezrael

+0

你能提供有問題的行的副本嗎? – IanS

回答

1

似乎有問題quoting,因爲如果分離是,thousands,太,一些報價必須處於csv

import pandas as pd 
from pandas.compat import StringIO 
import csv 

temp=u"""'a','Base Amount' 
'11','79,026,695.50'""" 
#after testing replace 'StringIO(temp)' to 'filename.csv' 
df = pd.read_csv(StringIO(temp), 
       dtype = { 'Base Amount' : 'float64' }, 
       thousands = ',' , 
       quotechar = "'", 
       quoting = csv.QUOTE_ALL, 
       decimal = '.', 
       encoding = 'ISO-8859-1') 

print (df) 
    a Base Amount 
0 11 79026695.5 

temp=u'''"a","Base Amount" 
"11","79,026,695.50"''' 
#after testing replace 'StringIO(temp)' to 'filename.csv' 
df = pd.read_csv(StringIO(temp), 
       dtype = { 'Base Amount' : 'float64' }, 
       thousands = ',' , 
       quotechar = '"', 
       quoting = csv.QUOTE_ALL, 
       decimal = '.', 
       encoding = 'ISO-8859-1') 

print (df) 
    a Base Amount 
0 11 79026695.5