【python3.X】Scrapy学习途径参考

如何爬取属性在不一样页面的item
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/request-response.html#topics-request-response-ref-request-callback-arguments
我要如何在spider里模拟用户登陆呢?
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/request-response.html#topics-request-response-ref-request-userlogin
Scrapy调试内存泄漏
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/leaks.html#topics-leaks
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/leaks.html#topics-leaks-without-leaks
Scrapy项目的例子？
http://scrapy-chs.readthedocs.io/zh_CN/0.24/intro/examples.html#intro-examples
发布Scrapy爬虫到生产环境
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/scrapyd.html#topics-scrapyd
在spider中启动shell来查看response.
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/shell.html#topics-shell-inspect-response

将全部爬取到的item转存(dump)到JSON/CSV/XML文件的最简单的方法?
dump到JSON文件:
scrapy crawl myspider -o items.json
dump到CSV文件:
scrapy crawl myspider -o items.csv
dump到XML文件:
scrapy crawl myspider -o items.xml
更多详情请参考 http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/feed-exports.html#topics-feed-exports

样例爬虫
http://github.com/AmbientLighter/rpn-fas/blob/master/fas/spiders/rnp.py
如何避免个人Scrapy机器人(bot)被禁止(ban)呢？
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/practices.html#bans