pyspider安装的过程当中,须要安装pycurl。有几个坑python
1、首先遇到权限的问题bash
由于/Library目录是root权限,因此非root用户对该目录的读写常常会遇到权限问题,可是不宜切换成root用户来安装应用,解决办法命令后面加上“--user”,curl
缘由以下:ide
Try "python setup.py install --user" You shouldn't use sudo as suggested above for two reasons:url
1.You're allowing arbitrary untrusted code off the internet to be run as rootspa
2.Passing the --user flag to python setup.py install will install the package to a user-owned directory..net
export PYCURL_SSL_LIBRARY=openssl
pip install pycurl
问题:'openssl/ssl.h' file not foundcode
解决办法:orm
brew install openssl
配置环境变量pyspider
编辑bash_profile
# openssl LD_LIBRARY_PATH=/usr/local/Cellar/openssl/1.0.2o_2/lib:"${LD_LIBRARY_PATH}" CPATH=/usr/local/Cellar/openssl/1.0.2o_2/include:"${CPATH}" PKG_CONFIG_PATH=/usr/local/Cellar/openssl/1.0.2o_2/lib/pkgconfig:"${PKG_CONFIG_PATH}" export LD_LIBRARY_PATH CPATH PKG_CONFIG_PATH export LDFLAGS=-L/usr/local/Cellar/openssl/1.0.2o_2/lib export CPPFLAGS=-I/usr/local/Cellar/openssl/1.0.2o_2/include
保存后,source, 再次执行一遍下面的命令
pip uninstall pycurl# 卸载包 export PYCURL_SSL_LIBRARY=openssl pip install pycurl --compile --no-cache-dir# 从新编译安装
OK
3、安装pyspider
pip install pyspider --user