- 首先根据对应系统平台安装docker
- sudo docker pull scrapinghub/splash 安装splash
- sudo docker run -p 8050:8050 -p 8051:8051 scrapinghug/splash 启动splash
- cd 到爬虫目录下,执行scrapy crawl lgcrawl -o jobs_all.csv 命令启动爬虫
python+scrapy+splash 爬取拉勾全站职位信息
python+scrapy+splash 爬取拉勾全站职位信息
Apache License 2.0