2012-04-26 88 views
4

具體而言,這個問題是關於如何獲得指定配額的提高或取消,而不是如何在現有配額限制內更有效。如何提高Google App Engine的隱藏「file.Open」配額

在GAE上運行MapReduce作業時,我達到了下面列出的配額限制。每天收到的「文件字節數」限制爲100GB,這是我從Blobstore收到的文件字節數。增加我的預算對100Gb /天的配額限制沒有影響。我希望完全解除限制,並支付我使用的費用。

輸出日誌中:

The API call file.Open() required more quota than is available. 
Traceback (most recent call last): 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 1511, in __call__ 
    rv = self.handle_exception(request, response, e) 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 1505, in __call__ 
    rv = self.router.dispatch(request, response) 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 1253, in default_dispatcher 
    return route.handler_adapter(request, response) 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 1077, in __call__ 
    return handler.dispatch() 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 547, in dispatch 
    return self.handle_exception(e, self.app.debug) 
    File "/base/python27_runtime/python27_lib/versions/third_party/webapp2-2.3/webapp2.py", line 545, in dispatch 
    return method(*args, **kwargs) 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/base_handler.py", line 68, in post 
    self.handle() 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/handlers.py", line 168, in handle 
    for entity in input_reader: 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/mapreduce_pipeline.py", line 109, in __iter__ 
    for binary_record in super(_ReducerReader, self).__iter__(): 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/input_readers.py", line 1615, in __iter__ 
    record = self._reader.read() 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/records.py", line 335, in read 
    (chunk, record_type) = self.__try_read_record() 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/records.py", line 292, in __try_read_record 
    header = self.__reader.read(HEADER_LENGTH) 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 569, in read 
    with open(self._filename, 'r') as f: 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 436, in open 
    exclusive_lock=exclusive_lock) 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 269, in __init__ 
    self._open() 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 393, in _open 
    self._make_rpc_call_with_retry('Open', request, response) 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 397, in _make_rpc_call_with_retry 
    _make_call(method, request, response) 
    File "/base/data/home/apps/s~utest-appgraph/69.358421800203055451/mapreduce/lib/files/file.py", line 243, in _make_call 
    rpc.check_success() 
    File "/base/python27_runtime/python27_lib/versions/1/google/appengine/api/apiproxy_stub_map.py", line 558, in check_success 
    self.__rpc.CheckSuccess() 
    File "/base/python27_runtime/python27_lib/versions/1/google/appengine/api/apiproxy_rpc.py", line 133, in CheckSuccess 
    raise self.exception 
OverQuotaError: The API call file.Open() required more quota than is available. 

回答

0

我打這個錯誤也是。我們正在使用appengine的「實驗備份」功能。這反過來會運行地圖縮小來將所有的appengine數據備份到谷歌雲存儲。但是,目前備份失敗並出現此錯誤:

OverQuotaError:API調用file.Open()需要比可用配額更多的配額。

而在配額儀表板,我們看到:

Other Quotas With Warnings 
These quotas are only shown when they have warnings 
File Bytes Sent 100% 107,374,182,400 of 107,374,182,400 Limited 

因此很明顯,有一個隱藏的配額「文件發送字節」我們已經打。但它沒有記錄在任何地方,我們可能從來不知道我們會打它....現在我們卡住

+0

嗨,我已經遇到同樣的問題時,將GAE數據導出到谷歌雲存儲。你找到了解決辦法嗎?如何提高這個限制?配額何時重置?我試過將任務隊列配置爲100msg/s。我試過聯繫Google,但迄今爲止沒有回覆。 – 2014-09-04 16:20:15