1. 首頁
  2. 問答
  3. AppEngine mapper API導入錯誤

AppEngine mapper API導入錯誤

2011-09-28 75 views
1

編輯：我只是給它一個去appengine本身，它似乎實際上在那裏工作，所以問題只是與開發服務器。我仍然有興趣瞭解爲什麼會發生這種情況...AppEngine mapper API導入錯誤

我正在使用AppEngine mapper API（mapreduce），並且遇到導入問題。這裏是我的文件結構：

├── [ost    12] app.yaml -> src/app.yaml 
├── [ost    4096] doc 
├── [ost    615] fabfile.py 
├── [ost    18] gae -> /home/ost/dev/gae/ 
├── [ost    70] INFO 
├── [ost    0] LICENSE 
├── [ost    5] README 
├── [ost    38] run_clean 
├── [ost    64] run_deploy 
├── [ost    83] run_pylint 
├── [ost    78] run_tests 
├── [ost    4096] src 
│   ├── [ost    4096] admin 
│   ├── [ost    504] app.yaml 
│   ├── [ost    4822] data.py 
│   ├── [ost    4096] dhandler 
│   ├── [ost    2273] ds.html 
│   ├── [ost    5424] generator.py 
│   ├── [ost    0] __init__.py 
│   ├── [ost    3527] lib.py 
│   ├── [ost    4211] main.py 
│   ├── [ost    457] mappers.py 
│   ├── [ost    298] mapreduce.yaml 
│   ├── [ost    4192] parser.py 
│   └── [ost    4096] static 
├── [ost    4096] test 
│   └── [ost    2445] test_data.py 
└── [ost    98] TODO

我的app.yaml是：

application: <removed> 
version: 1 
runtime: python 
api_version: 1 

builtins: 
- datastore_admin: on 
- appstats: on 

handlers: 
- url: /remote_api 
    script: $PYTHON_LIB/google/appengine/ext/remote_api/handler.py 
    login: admin 

- url: /admin 
    script: admin/admin.py 
    login: admin 

- url: /dhandler/.* 
    script: dhandler/dhandler.py 

- url: /mapreduce(/.*)? 
    script: $PYTHON_LIB/google/appengine/ext/mapreduce/main.py 
    login: admin 

- url: /static 
    static_dir: static 

- url: /.* 
    script: main.py

我mapreduce.yaml：

mapreduce: 
- name: insert-domain-mapper 
    params: 
    - name: done_callback 
    value: /dhandler/insert_job_done 
    mapper: 
    input_reader: google.appengine.ext.mapreduce.input_readers.BlobstoreLineInputReader 
    handler: mappers.insert_domain 
    params: 
    - name: blob_keys 
     default: ""

最後mappers.py

from google.appengine.ext.mapreduce import operation as op 

from data import RegisteredDomain, make_key, clean_domain 

def insert_domain((byte_offset, line)): 

    domain = line 

    # TODO: domain validity check (??) 

    # clean domain 
    domain = clean_domain(domain) 

    # create domain entity 
    domain_entity = RegisteredDomain(key_name=make_key(domain)) 

    # yield put operation 
    yield op.db.Put(domain_entity)

現在問題是，雖然我可以加載/ MapReduce的頁面和作業是可用的，當我嘗試啓動工作，我得到以下錯誤（在頁面上）：

ImportError: Could not find 'input_readers' on path 'google.appengine.ext.mapreduce'

下面是一個完整的堆棧跟蹤：

DEBUG 2011-09-28 18:30:54,829 dev_appserver.py:3022] Executing CGI with env: 
{'HTTP_ACCEPT': 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8', 'HTTP_CONNECTION': 'keep-alive', 
'CONTENT_TYPE': 'application/x-www-form-urlencoded', 'HTTP_COOKIE': 'dev_appserver_login="[email protected]:True:1858 
04764220139124118"', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'CURRENT_VERSION_ID': '1.1', 'SERVER_S 
OFTWARE': 'Development/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '', 'REQUEST_METHOD': 'GET', 'HTTP_HOST': '10.1 
.2.20:8000', 'PATH_INFO': '/mapreduce/status', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUERY_STRING': '', 'TZ': 'UTC', 'HTTP 
_CACHE_CONTROL': 'max-age=0', 'USER_EMAIL': '[email protected]', 'USER_IS_ADMIN': '1', 'CONTENT_LENGTH': '', 'USER_ID 
': '185804764220139124118', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like G 
ecko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', 'SERVER_NAME': '10.1.2.20', 'REMOTE 
_ADDR': '10.1.2.5', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q=0.8', 'SDK_VERSION': '1.5.2' 
, 'PATH_TRANSLATED': '/home/ost/dev/gae/google/appengine/ext/mapreduce/main.py', 'SERVER_PORT': '8000', 'AUTH_DOMAIN 
': 'gmail.com'} 
DEBUG 2011-09-28 18:30:54,830 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
educe.main" 

    INFO  2011-09-28 18:30:54,841 dev_appserver.py:4248] "GET /mapreduce/status HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:54,843 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:54,890 dev_appserver.py:589] Matched "/mapreduce/base.css" to CGI dispatcher with path $PY 
    THON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:54,894 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': 'text/css,*/*;q=0.1', 'HTTP_CONNECTION': 'keep-alive', 'CONTENT_TYPE': 'application/x-www-form-urlen 
    coded', 'HTTP_REFERER': 'http://10.1.2.20:8000/mapreduce/status', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q 
    =0.3', 'CURRENT_VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Development/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '' 
    , 'REQUEST_METHOD': 'GET', 'HTTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/mapreduce/base.css', 'SERVER_PROTOCOL': 'HT 
    TP/1.0', 'QUERY_STRING': '', 'TZ': 'UTC', 'USER_EMAIL': '[email protected]', 'USER_IS_ADMIN': '1', 'CONTENT_LENGTH': 
    '', 'USER_ID': '185804764220139124118', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (K 
    HTML, like Gecko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', 'HTTP_COOKIE': 'dev_app 
    server_login="[email protected]:True:185804764220139124118"', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', 
    'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q=0.8', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': 
    '/home/ost/dev/gae/google/appengine/ext/mapreduce/main.py', 'SERVER_PORT': '8000', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:54,895 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    INFO  2011-09-28 18:30:54,902 dev_appserver.py:4248] "GET /mapreduce/base.css HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:54,903 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:54,911 dev_appserver.py:589] Matched "/mapreduce/jquery.js" to CGI dispatcher with path $P 
    YTHON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:54,915 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': '*/*', 'HTTP_CONNECTION': 'keep-alive', 'CONTENT_TYPE': 'application/x-www-form-urlencoded', 'HTTP_R 
    EFERER': 'http://10.1.2.20:8000/mapreduce/status', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'CURRENT 
    _VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Development/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '', 'REQUEST_METH 
    OD': 'GET', 'HTTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/mapreduce/jquery.js', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUER 
    Y_STRING': '', 'TZ': 'UTC', 'USER_EMAIL': '[email protected]', 'USER_IS_ADMIN': '1', 'CONTENT_LENGTH': '', 'USER_ID': 
    '185804764220139124118', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gec 
    ko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', 'HTTP_COOKIE': 'dev_appserver_login=" 
    [email protected]:True:185804764220139124118"', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', 'GATEWAY_INTER 
    FACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q=0.8', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/de 
    v/gae/google/appengine/ext/mapreduce/main.py', 'SERVER_PORT': '8000', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:54,916 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    INFO  2011-09-28 18:30:54,924 dev_appserver.py:4248] "GET /mapreduce/jquery.js HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:54,931 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:54,938 dev_appserver.py:589] Matched "/mapreduce/status.js" to CGI dispatcher with path $P 
    YTHON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:54,942 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': '*/*', 'HTTP_CONNECTION': 'keep-alive', 'CONTENT_TYPE': 'application/x-www-form-urlencoded', 'HTTP_R 
    EFERER': 'http://10.1.2.20:8000/mapreduce/status', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'CURRENT 
    _VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Development/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '', 'REQUEST_METH 
    OD': 'GET', 'HTTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/mapreduce/status.js', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUER 
    Y_STRING': '', 'TZ': 'UTC', 'USER_EMAIL': '[email protected]', 'USER_IS_ADMIN': '1', 'CONTENT_LENGTH': '', 'USER_ID': 
    '185804764220139124118', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHTML, like Gec 
    ko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', 'HTTP_COOKIE': 'dev_appserver_login=" 
    [email protected]:True:185804764220139124118"', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', 'GATEWAY_INTER 
    FACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q=0.8', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/de 
    v/gae/google/appengine/ext/mapreduce/main.py', 'SERVER_PORT': '8000', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:54,943 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    INFO  2011-09-28 18:30:54,951 dev_appserver.py:4248] "GET /mapreduce/status.js HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:54,953 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:54,972 dev_appserver.py:589] Matched "/mapreduce/command/list_configs" to CGI dispatcher w 
    ith path $PYTHON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:54,976 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': 'text/plain, */*', 'HTTP_CONNECTION': 'keep-alive', 'USER_IS_ADMIN': '1', 'HTTP_COOKIE': 'dev_appser 
    ver_login="[email protected]:True:185804764220139124118"', 'CURRENT_VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Developme 
    nt/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '', 'USER_ID': '185804764220139124118', 'REQUEST_METHOD': 'GET', 'H 
    TTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/mapreduce/command/list_configs', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUERY_S 
    TRING': '', 'TZ': 'UTC', 'HTTP_X_REQUESTED_WITH': 'XMLHttpRequest', 'USER_EMAIL': '[email protected]', 'CONTENT_LENGT 
    H': '', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WO 
    W64) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich' 
    , 'HTTP_REFERER': 'http://10.1.2.20:8000/mapreduce/status', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', ' 
    CONTENT_TYPE': 'application/x-www-form-urlencoded', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,e 
    n;q=0.8', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/dev/gae/google/appengine/ext/mapreduce/main.py', 'SE 
    RVER_PORT': '8000', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:54,977 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    INFO  2011-09-28 18:30:54,991 dev_appserver.py:4248] "GET /mapreduce/command/list_configs HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:54,992 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:54,999 dev_appserver.py:589] Matched "/mapreduce/command/list_jobs" to CGI dispatcher with 
    path $PYTHON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:55,003 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': 'text/plain, */*', 'HTTP_CONNECTION': 'keep-alive', 'USER_IS_ADMIN': '1', 'HTTP_COOKIE': 'dev_appser 
    ver_login="[email protected]:True:185804764220139124118"', 'CURRENT_VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Developme 
    nt/1.0', 'SCRIPT_NAME': '', 'USER_ORGANIZATION': '', 'USER_ID': '185804764220139124118', 'REQUEST_METHOD': 'GET', 'H 
    TTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/mapreduce/command/list_jobs', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUERY_STRI 
    NG': '', 'TZ': 'UTC', 'HTTP_X_REQUESTED_WITH': 'XMLHttpRequest', 'USER_EMAIL': '[email protected]', 'CONTENT_LENGTH': 
    '', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64 
    ) AppleWebKit/535.2 (KHTML, like Gecko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', ' 
    HTTP_REFERER': 'http://10.1.2.20:8000/mapreduce/status', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', 'CON 
    TENT_TYPE': 'application/x-www-form-urlencoded', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q 
    =0.8', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/dev/gae/google/appengine/ext/mapreduce/main.py', 'SERVE 
    R_PORT': '8000', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:55,003 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    INFO  2011-09-28 18:30:55,012 dev_appserver.py:4248] "GET /mapreduce/command/list_jobs HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:55,013 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:55,019 dev_appserver.py:589] Matched "/favicon.ico" to CGI dispatcher with path main.py 
    DEBUG 2011-09-28 18:30:55,022 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_ACCEPT': '*/*', 'HTTP_CONNECTION': 'keep-alive', 'CONTENT_TYPE': 'application/x-www-form-urlencoded', 'HTTP_C 
    OOKIE': 'dev_appserver_login="[email protected]:True:185804764220139124118"', 'HTTP_ACCEPT_CHARSET': 'ISO-8859-1,utf- 
    8;q=0.7,*;q=0.3', 'CURRENT_VERSION_ID': '1.1', 'SERVER_SOFTWARE': 'Development/1.0', 'SCRIPT_NAME': '', 'USER_ORGANI 
    ZATION': '', 'REQUEST_METHOD': 'GET', 'HTTP_HOST': '10.1.2.20:8000', 'PATH_INFO': '/favicon.ico', 'SERVER_PROTOCOL': 
    'HTTP/1.0', 'QUERY_STRING': '', 'TZ': 'UTC', 'USER_EMAIL': '[email protected]', 'USER_IS_ADMIN': '1', 'CONTENT_LENGT 
    H': '', 'USER_ID': '185804764220139124118', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535. 
    2 (KHTML, like Gecko) Chrome/15.0.874.24 Safari/535.2', 'APPLICATION_ID': 'dev~domain-sandwich', 'SERVER_NAME': '10. 
    1.2.20', 'REMOTE_ADDR': '10.1.2.5', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en;q=0.8', 'SDK_V 
    ERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/dev/domain-sandwich/src/main.py', 'SERVER_PORT': '8000', 'AUTH_DOMAI 
    N': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:55,022 dev_appserver.py:2721] Reusing main() function of module "main" 
    INFO  2011-09-28 18:30:55,028 dev_appserver.py:4248] "GET /favicon.ico HTTP/1.1" 404 - 
    DEBUG 2011-09-28 18:30:55,029 dev_appserver_index.py:172] No need to update index.yaml 
    DEBUG 2011-09-28 18:30:56,662 dev_appserver.py:589] Matched "/mapreduce/command/start_job" to CGI dispatcher with 
    path $PYTHON_LIB/google/appengine/ext/mapreduce/main.py 
    DEBUG 2011-09-28 18:30:56,670 dev_appserver.py:3022] Executing CGI with env: 
    {'HTTP_COOKIE': 'dev_appserver_login="[email protected]:True:185804764220139124118"', 'SERVER_SOFTWARE': 'Development 
    /1.0', 'SCRIPT_NAME': '', 'REQUEST_METHOD': 'POST', 'PATH_INFO': '/mapreduce/command/start_job', 'HTTP_ORIGIN': 'htt 
    p://10.1.2.20:8000', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUERY_STRING': '', 'CONTENT_LENGTH': '232', 'HTTP_ACCEPT_CHARSE 
    T': 'ISO-8859-1,utf-8;q=0.7,*;q=0.3', 'HTTP_USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/535.2 (KHT 
    ML, like Gecko) Chrome/15.0.874.24 Safari/535.2', 'TZ': 'UTC', 'HTTP_REFERER': 'http://10.1.2.20:8000/mapreduce/stat 
    us', 'SERVER_NAME': '10.1.2.20', 'REMOTE_ADDR': '10.1.2.5', 'SDK_VERSION': '1.5.2', 'PATH_TRANSLATED': '/home/ost/de 
    v/gae/google/appengine/ext/mapreduce/main.py', 'SERVER_PORT': '8000', 'USER_IS_ADMIN': '1', 'HTTP_X_REQUESTED_WITH': 
    'XMLHttpRequest', 'CURRENT_VERSION_ID': '1.1', 'USER_ORGANIZATION': '', 'USER_ID': '185804764220139124118', 'HTTP_H 
    OST': '10.1.2.20:8000', 'HTTP_CONNECTION': 'keep-alive', 'USER_EMAIL': '[email protected]', 'HTTP_ACCEPT': 'text/plai 
    n, */*', 'APPLICATION_ID': 'dev~domain-sandwich', 'GATEWAY_INTERFACE': 'CGI/1.1', 'HTTP_ACCEPT_LANGUAGE': 'en-US,en; 
    q=0.8', 'CONTENT_TYPE': 'application/x-www-form-urlencoded', 'AUTH_DOMAIN': 'gmail.com'} 
    DEBUG 2011-09-28 18:30:56,671 dev_appserver.py:2721] Reusing main() function of module "google.appengine.ext.mapr 
    educe.main" 
    DEBUG 2011-09-28 18:30:56,688 dev_appserver.py:2198] Could not import "_io": Disallowed C-extension or built-in m 
    odule 
    DEBUG 2011-09-28 18:30:56,689 util.py:105] Could not import BlobstoreLineInputReader from google.appengine.ext.ma 
    preduce.input_readers. Will try recursively. 
    Traceback (most recent call last): 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/util.py", line 90, in for_name 
     result = __import__(module_name, None, None, [short_name]) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/input_readers.py", line 59, in <module> 
     import zipfile 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/usr/lib/python2.7/zipfile.py", line 6, in <module> 
     import io 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/usr/lib/python2.7/io.py", line 60, in <module> 
     import _io 
    ImportError: No module named _io 
    DEBUG 2011-09-28 18:30:56,698 dev_appserver.py:2198] Could not import "_io": Disallowed C-extension or built-in m 
    odule 
    DEBUG 2011-09-28 18:30:56,698 util.py:105] Could not import input_readers from google.appengine.ext.mapreduce. Wi 
    ll try recursively. 
    Traceback (most recent call last): 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/util.py", line 90, in for_name 
     result = __import__(module_name, None, None, [short_name]) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/input_readers.py", line 59, in <module> 
     import zipfile 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/usr/lib/python2.7/zipfile.py", line 6, in <module> 
     import io 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2503, in load_module 
     return self.FindAndLoadModule(submodule, fullname, search_path) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2375, in FindAndLoadModule 
     description) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 1538, in Decorate 
     return func(self, *args, **kwargs) 
     File "/home/ost/dev/gae/google/appengine/tools/dev_appserver.py", line 2318, in LoadModuleRestricted 
     description) 
     File "/usr/lib/python2.7/io.py", line 60, in <module> 
     import _io 
    ImportError: No module named _io 
    ERROR 2011-09-28 18:30:56,702 base_handler.py:140] Error in JsonHandler, returning exception. 
    Traceback (most recent call last): 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/base_handler.py", line 133, in _handle_wrapper 
     self.handle() 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/handlers.py", line 762, in handle 
     _app=mapper_params.get("_app")) 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/handlers.py", line 826, in _start_map 
     mapper_input_reader_class = mapper_spec.input_reader_class() 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/model.py", line 408, in input_reader_class 
     return util.for_name(self.input_reader_spec) 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/util.py", line 109, in for_name 
     module = for_name(module_name, recursive=True) 
     File "/home/ost/dev/gae/google/appengine/ext/mapreduce/util.py", line 117, in for_name 
     short_name, module_name)) 
    ImportError: Could not find 'input_readers' on path 'google.appengine.ext.mapreduce' (????) 
    INFO  2011-09-28 18:30:56,710 dev_appserver.py:4248] "POST /mapreduce/command/start_job HTTP/1.1" 200 - 
    DEBUG 2011-09-28 18:30:56,711 dev_appserver_index.py:172] No need to update index.yaml

來源

2011-09-28 o1iver

+0

您的本地SDK似乎有些問題 - 您是否檢查過google/appengine/ext/mapreduce/input_readers.py（以及同一目錄中的__init __。py'文件）是否可讀？ –

回答

1

這可能是我遇到的同樣的問題 - 我在本地環境中使用了2.7版本的Python解釋器。當我切換到2.5時，它工作正常。

來源

2011-10-17 20:24:15 leontx

相關問題

 相關問題