centos7.2 安装

  • 在尝试了vagrant和docker安装均启动失败后,尝试用云服务器一个个依赖手动安装,本文章纯作记录
  • 系统
  • python

    安装pip工具(本文只为熟悉所有依赖,为方便能使用yum安装的尽量会选择yum安装,没有网络环境只能自己想办法了~~~)

yum -y install epel-release
yum -y install python-pip

  安装git工具

yum install -y git

  安装scrapy

pip install scrapy

  解决办法:安装gcc,g++

yum -y install gcc gcc-c++

  重新安装scrapy

  解决办法:安装python-devel(ubuntu里好像叫python-dev)

yum install -y python-devel

  解决办法:安装openssl-devel

yum install -y openssl-devel

  重新执行pip install scrapy后安装成功。

  安装virtualenv

pip install virtualenv

  创建一个虚拟环境,随便命名一个,这里我命名为“pot”

virtualenv pot
source pot/bin/activate mkdir pot (第一次安装在发现在虚拟环境里安装numpy会有问题,所以直接在云服务器环境上安装)
cd pot
git clone https://github.com/scrapinghub/portia.git
cd portia/slyd/bin
./slyd

安装splash

pip install splash

安装Qt5

yum install -y qt5-qtquickcontrols qt5-qtdeclarative-devel qt5-qtwebkit qt5-qtwebkit-devel

安装sip

wget https://sourceforge.net/projects/pyqt/files/sip/sip-4.19/sip-4.19.tar.gz
tar -zxvf sip-4.19.tar.gz
cd sip-4.19
python configure.py
make
make install
make clean

安装pyqt5

wget https://sourceforge.net/projects/pyqt/files/PyQt5/PyQt-5.7.1/PyQt5_gpl-5.7.1.tar.gz
tar -zxvf PyQt5_gpl-5.7.1.tar.gz
cd PyQt5_gpl-5.7.1
python configure.py --qmake=/usr/bin/qmake-qt5
make all (耗时有点长,给点耐心)
make install
make clean

pip install -v xvfbwrapper==0.2.7

yum install python-xvfbwrapper

export PYTHONPATH='/root/pot/portia/portia_server:/root/pot/portia/slyd:/root/pot/portia/slybot'

pip install -v django==1.10.1

pip install -v whitenoise==3.2

pip install -v marshmallow==2.8.0

yum install numpy
pip install scrapy

pip install dateparser

pip install page_finder

pip install dulwich

pip install toposort

pip install autobahn

pip install loginform

pip install requests

未完待续

 

posted on 2017-02-23 17:16  tyanf  阅读(704)  评论(0编辑  收藏  举报

导航