2
我有結構化的這樣一個HDF5(PyTables)文件:PyTables +熊貓選擇問題
/<User>/<API Key>
ex:
/Dan/A4N5
/Dan/B8P0
/Dave/D3Y7
每個表的結構,像這樣與存儲在時代一個會話ID和時間:
sessionID time
0 3ODE3Nzll 1467590400
1 lMGVkMDc4 1467590400
2 jNzIzNmY1 1467590400
...
我希望Pandas遍歷每個表並獲取指定日期和指定日期前一天之間的所有行。目前我有這樣的代碼:
scriptPath = os.path.dirname(os.path.abspath(__file__))
argdate = "2016/07/14"
dayTimestamp = datetime.datetime(int(argdate[0:4]), int(argdate[5:7]), int(argdate[8:10]), tzinfo=pytz.utc)
yesterdayTimestamp = dayTimestamp - datetime.timedelta(days=1)
with pd.HDFStore(os.path.join(scriptPath, "userdatabase.h5")) as db:
for table in db.keys():
print(table)
tableSplit = table.split('/')
client = tableSplit[1]
apiKey = tableSplit[2]
df = db.select('{}/{}'.format(client, apiKey), where='time<=int(dayTimestamp.timestamp()) & time>=int(yesterdayTimestamp.timestamp())')
print(df)
但是拋出一個錯誤的選擇位於行。
File "tester.py", line 570, in database
df = db.select('{}/{}'.format(client, apiKey), where='time<=int(dayTimestamp.timestamp()) & time>=int(yesterdayTimestamp.timestamp())')
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 680, in select
return it.get_result()
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 1364, in get_result
results = self.func(self.start, self.stop, where)
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 673, in func
columns=columns, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 4021, in read
if not self.read_axes(where=where, **kwargs):
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 3222, in read_axes
self.selection = Selection(self, where=where, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 4580, in __init__
self.terms = self.generate(where)
File "/usr/local/lib/python3.4/dist-packages/pandas/io/pytables.py", line 4593, in generate
return Expr(where, queryables=q, encoding=self.table.encoding)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/pytables.py", line 517, in __init__
self.terms = self.parse()
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 727, in parse
return self._visitor.visit(self.expr)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 317, in visit_Module
return self.visit(expr, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 320, in visit_Expr
return self.visit(node.value, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 655, in visit_BoolOp
return reduce(visitor, operands)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 647, in visitor
lhs = self._try_visit_binop(x)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 643, in _try_visit_binop
return self.visit(bop)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 628, in visit_Compare
return self.visit(binop)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 401, in visit_BinOp
op, op_class, left, right = self._possibly_transform_eq_ne(node)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 354, in _possibly_transform_eq_ne
right = self.visit(node.right, side='right')
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 311, in visit
return visitor(node, **kwargs)
File "/usr/local/lib/python3.4/dist-packages/pandas/computation/expr.py", line 615, in visit_Call_legacy
return self.const_type(res(*args, **keywords), self.env)
TypeError: 'str' object is not callable
1)如何解決這個錯誤?
2)是否可以遍歷HDF5文件層次結構,以便可以將Pandas表分組?
你的代碼的行生成此錯誤消息?你可以發佈完整的錯誤追溯? – MaxU
添加了完整的錯誤消息 – DeadCake