centos7
默认Python 2.7,支持twisted
首先准备环境
yum install gcc libffi-devel openssl-devel libxml2 libxslt-devel libxml2-devel python-devel -y
Ubuntu :
sudo apt-get install build-essential python3-dev libssl-dev libffi-dev libxml2 libxml2-dev libxslt1-dev zlib1g-dev
安装easy_install
yum install python-setuptools
安装pip
easy_install pip
安装 lxml
easy_install lxml
如果以上都顺利,就开始安装scrapy吧
pip install scrapy