scrapy-splash使用CrawlSpider。scrapy-splash全站爬取

使用scrapy-splash进行全站爬取 #!/usr/bin/env python # -*- coding: utf-8 -*- from scrapy.spiders import CrawlSpider, Rule from scrapy_splash import SplashRequest from scrapy.linkextractors import LinkExtract

>>阅读原文<<