4
我正在寫蜘蛛公共FTP站點與身份驗證scrapy公共FTP站點與認證數據,獲取FTP錯誤
我給了ftp的用戶名和密碼。 Scrapy不處理這個請求,並給予其「FTP_USER」錯誤
# all import stmt
class my_xml(BaseSpider):
name = 'my_xml'
def start_requests(self):
yield Request(
url='url',
meta={'ftp_user': self.ftp_user, 'ftp_password': self.ftp_password}
)
def parse(self, response):
print response.body
我流汗錯誤是這樣的。
2015-04-03 12:46:08+0530 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023
2015-04-03 12:46:08+0530 [scrapy] DEBUG: Web service listening on 127.0.0.1:6080
2015-04-03 12:46:08+0530 [-] ERROR: Unhandled error in Deferred:
2015-04-03 12:46:08+0530 [-] Unhandled Error
Traceback (most recent call last):
File "C:\Python27\lib\site-packages\scrapy\core\downloader\middleware.py", line 38, in process_request
return download_func(request=request, spider=spider)
File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 123, in _enqueue_request
self._process_queue(spider, slot)
File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 143, in _process_queue
dfd = self._download(slot, request, spider)
File "C:\Python27\lib\site-packages\scrapy\core\downloader\__init__.py", line 154, in _download
dfd = mustbe_deferred(self.handlers.download_request, request, spider)
--- <exception caught here> ---
File "C:\Python27\lib\site-packages\scrapy\utils\defer.py", line 39, in mustbe_deferred
result = f(*args, **kw)
File "C:\Python27\lib\site-packages\scrapy\core\downloader\handlers\__init__.py", line 40, in download_request
return handler(request, spider)
File "C:\Python27\lib\site-packages\scrapy\core\downloader\handlers\ftp.py", line 72, in download_request
creator = ClientCreator(reactor, FTPClient, request.meta["ftp_user"],
exceptions.KeyError: 'ftp_user'
任何人都可以爲這個錯誤提供解決方案。 ?如果我做錯了程序,請給我建議適當的解決方案。如何處理這些類型的蜘蛛? 請注意:URL,ftp_user和ftp_password是正確的,在瀏覽器中我們可以用這些數據打開它。