1
我想使用scrapy從網頁下載圖像的例子。Scrapy:沒有模塊命名的項目,刮圖像
這是蜘蛛文件:
from scrapy import Spider, Item, Field, Request
from items import TrousersItem
class TrouserScraper(Spider):
name, start_urls = "Trousers_spider", ["http://lookatmyfuckingredtrousers.blogspot.co.uk"]
def parse(self, response):
for image in response.selector.xpath('//*[contains(@class, "entry-content")]/div[contains(@class, "separator")]/a/img/@src'):
yield TrousersItem(image_urls=[image.extract()])
for url in response.selector.xpath("//*[contains(@class, 'blog-pager-older-link')]/@href"):
yield Request(url.extract(), callback=self.parse)
而且items.py:
import scrapy
from scrapy.item import Item
class TrousersItem(scrapy.Item):
image_urls = scrapy.Field()
images = scrapy.Field()
當我鍵入
scrapy crawl Trousers_spider
我得到這個錯誤:
No module named items