step1: python & scrapy安装

#首先安装python,这里安装python所需依赖包
yum install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gcc make

 

#解压缩安装包并编译安装
tar -zxvf Python-3.6.2.tgz

cd Python-3.6.2

./configure --prefix=/usr/local

make && make install

#建立软连接
mv python python.bak

ln -s /usr/local/bin/python3 /usr/bin/python

#pip安装scrapy爬虫框架
pip3 install -i https://pypi.douban.com/simple scrapy

 

按照以下所示配置pycharm远端服务器：