在CentOs6.5下安装Python2.7.6和Scrapy
总在网上看你们的安装教程,这回本身也贡献一份!!!css
和民航大学合做项目,去给人家装环境,连简单的Scrapy都没装上,虽然有对方硬件设施坑爹的因素,但主要仍是本身准备不充分。html
一份好的安装文档应该是能够完美重现的。python
因此作了下面这份:sql
我按照这套方法连着重装了四次,若是各位直接复制命令,应该是一点问题都没有。安装成功的样子见那两张截图。bootstrap
对了,确保电脑能上网,鼠标能用,哈哈vim
1.#su – rootpython2.7
2.#yum install gcc zlib-devel bzip2-devel openssl-devel ncurses-devel libffi-devel libxslt-devel libxml2-devel sqlite-develscrapy
3.#cd /usride
4.安装Python
#wget http://www.python.org/ftp/python/2.7.6/Python-2.7.6.tar.xz
#xz -d Python-2.7.6.tar.xz
#tar xvf Python-2.7.6.tar
#cd Python-2.7.6
#./configurepost
#vim Modules/Setup
找到下面这句,去掉注释
#zlib zlibmodule.c -I$(prefix)/include -L$(exec_prefix)/lib -lz
编译安装:make & make install
5.修改Python连接
#/usr/local/bin/python2.7 -V
#mv /usr/bin/python /usr/bin/python.bak
# ln -s /usr/local/bin/python2.7 /usr/bin/python
6.#vim /usr/bin/yum
在打开的文件里的头一行,也就是指定python环境的那行代码,修改为:
#!/usr/bin/python2.6
7.#wget --no-check-certificate https://bootstrap.pypa.io/ez_setup.py
#python ez_setup.py
8.#wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py
#python get-pip.py
9.#pip install scrapy
10.#scrapy
11.创建测试脚本
12.# cat > myspider.py <<EOF
from scrapy import Spider, Item, Field
class Post(Item):
title = Field()
class BlogSpider(Spider):
name, start_urls = 'blogspider', ['http://www.cnblogs.com/rwxwsblog/']
def parse(self, response):
return [Post(title=e.extract()) for e in response.css("h2 a::text")]
EOF
13.试建工程
scrapy startproject tutorial