scrapy不支持的響應類型圖像/ jpeg

我想使用默認的ImagePipeline scrapy將圖像從網站上刮掉。但是，我遇到這個錯誤。scrapy不支持的響應類型圖像/ jpeg

Traceback (most recent call last): 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/middleware.py", line 62, in _process_chain 
    return process_chain(self.methods[methodname], obj, *args) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/utils/defer.py", line 65, in process_chain 
    d.callback(input) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 383, in callback 
    self._startRunCallbacks(result) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 491, in _startRunCallbacks 
    self._runCallbacks() 
--- <exception caught here> --- 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 578, in _runCallbacks 
    current.result = callback(current.result, *args, **kw) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/contrib/pipeline/media.py", line 40, in process_item 
    requests = arg_to_iter(self.get_media_requests(item, info)) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/contrib/pipeline/images.py", line 104, in get_media_requests 
    return [Request(x) for x in item.get(self.IMAGES_URLS_FIELD, [])] 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/http/request/__init__.py", line 26, in __init__ 
    self._set_url(url) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/http/request/__init__.py", line 57, in _set_url 
    self._set_url(url.encode(self.encoding)) 
    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/http/request/__init__.py", line 61, in _set_url 
    raise ValueError('Missing scheme in request url: %s' % self._url) 
exceptions.ValueError: Missing scheme in request url: h

我的代碼：

# -*- coding: utf-8 -*- 
import scrapy 
from scrapy.contrib.linkextractors import LinkExtractor 
from scrapy.contrib.spiders import CrawlSpider, Rule 
from extrapetite.items import ExtrapetiteItem 


class ExtrapetiteCsSpider(CrawlSpider): 
    name = 'extrapetite_cs' 
    allowed_domains = ['www.extrapetite.com'] 
    start_urls = ['http://www.extrapetite.com/'] 

    rules = [ 
     Rule(
      LinkExtractor(allow=['/search/label/Lookbook']), 
      callback='parse_link', 
      follow=True 
      ) 
    ] 

    def parse_link(self, response): 
     for thing in response.xpath('//*[@id="Blog1"]/div[1]/div[position()>2]/div/div/div/div[3]/a/@href'): 
      request = scrapy.Request(thing.extract(), callback=self.parse_img) 
      yield request 



    def parse_img(self,response): 
     for thing in response.xpath('//*[@id="Blog1"]/div[1]/div/div/div[1]/div[1]/div[2]/a[position()>0]/img'): 
      item = ExtrapetiteItem() 
      item['image_urls'] = thing.xpath('@src').extract()[0] 
      item['url'] = response.url 
      item['desc'] = thing.xpath('@alt').extract()[0] 
      yield item

我的設置：

# -*- coding: utf-8 -*- 

# Scrapy settings for extrapetite project 
# 
# For simplicity, this file contains only the most important settings by 
# default. All the other settings are documented here: 
# 
#  http://doc.scrapy.org/en/latest/topics/settings.html 
# 

BOT_NAME = 'extrapetite' 

SPIDER_MODULES = ['extrapetite.spiders'] 
NEWSPIDER_MODULE = 'extrapetite.spiders' 

FEED_URI = 'logs/%(time)s.csv' 
FEED_FORMAT = 'csv' 

ITEM_PIPELINES = { 
    'scrapy.contrib.pipeline.images.ImagesPipeline': 1 
} 

IMAGES_STORE = '/Users/crescal/compsci/ggslh/extrapetite/images/' 
IMAGES_EXPIRES = 90 


# Crawl responsibly by identifying yourself (and your website) on the user-agent 
#USER_AGENT = 'extrapetite (+http://www.yourdomain.com)'

如果不啓用ImagePipeline，我能夠抓取網站並獲取圖片網址，網址和說明。

此外，當我嘗試使用 scrapy視圖中查看鏈接https://farm9.staticflickr.com/8802/16977938339_20f05dc232_o.jpg

我得到這個錯誤

2015-05-08 13:31:37+0800 [default] DEBUG: Crawled (200) <GET https://farm9.staticflickr.com/8802/16977938339_20f05dc232_o.jpg> (referer: None) 
2015-05-08 13:31:37+0800 [default] ERROR: Spider error processing <GET https://farm9.staticflickr.com/8802/16977938339_20f05dc232_o.jpg> 
    Traceback (most recent call last): 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/base.py", line 1201, in mainLoop 
     self.runUntilCurrent() 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/base.py", line 824, in runUntilCurrent 
     call.func(*call.args, **call.kw) 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 383, in callback 
     self._startRunCallbacks(result) 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 491, in _startRunCallbacks 
     self._runCallbacks() 
    --- <exception caught here> --- 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/twisted/internet/defer.py", line 578, in _runCallbacks 
     current.result = callback(current.result, *args, **kw) 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/commands/fetch.py", line 47, in <lambda> 
     cb = lambda x: self._print_response(x, opts) 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/commands/view.py", line 20, in _print_response 
     open_in_browser(response) 
     File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/scrapy/utils/response.py", line 86, in open_in_browser 
     response.__class__.__name__) 
    exceptions.TypeError: Unsupported response type: Response

URL的內容類型圖像/ JPEG，這是爲什麼我不能查看這個？

來源

2015-05-08 nitecrawler2020