Scrapy回調str問題

我想運行使用Scrapy的刮板，我可以在過去使用此代碼，但現在我得到一個奇怪的錯誤。Scrapy回調str問題

_rules =(Rule(LinkExtractor(restrict_xpaths=(xpath_str)), follow=True, 
      callback='parse_url'),) 

def parse_url(self, response): 
    print response.url 
    ...

基本上我回來當我運行它是：

Traceback (most recent call last): 


File "/usr/lib/pymodules/python2.7/scrapy/utils/defer.py", line 102, in iter_errback 
    yield next(it) 
    File "/usr/lib/pymodules/python2.7/scrapy/spidermiddlewares/offsite.py", line 28, in process_spider_output 
    for x in result: 
    File "/usr/lib/pymodules/python2.7/scrapy/spidermiddlewares/referer.py", line 22, in <genexpr> 
    return (_set_referer(r) for r in result or()) 
    File "/usr/lib/pymodules/python2.7/scrapy/spidermiddlewares/urllength.py", line 37, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/usr/lib/pymodules/python2.7/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr> 
    return (r for r in result or() if _filter(r)) 
    File "/usr/lib/pymodules/python2.7/scrapy/spiders/crawl.py", line 67, in _parse_response 
    cb_res = callback(response, **cb_kwargs) or() 
TypeError: 'str' object is not callable

任何想法，爲什麼出現這種情況？我在另一個刮板上有一個非常類似的代碼，它的工作原理是？！

下面是完整的代碼

from scrapy.linkextractors import LinkExtractor 
from scrapy.spiders import CrawlSpider, Rule 
from ..model import Properties 


class TestScraper(CrawlSpider): 
     name = "test" 
     start_urls = [Properties.start_url] 

    _rules =(Rule(LinkExtractor(restrict_xpaths=(Properites.xpath)), follow=True, callback='parse_url'),) 

     def parse_url(self, response): 
      print response.url

來源

2015-12-19 ilijaluve

你有一個叫做'parse_url'的函數嗎？那麼你需要指定'parse_url'而不是''parse_url'' – falsetru

你確定這與規則裏面的'callback'有關嗎？請發佈您的蜘蛛的完整代碼。 – alecxe

@falsetru我有一個函數parse_url，並嘗試了你的建議，但它不起作用。 – ilijaluve

變化callback='parse_url'到callback=self.parse_url。

來源

2015-12-19 15:53:34 masnun

Scrapy回調str問題

回答

相關問題