j4qfrost / paper_scraper

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

paper_scraper

pip3 install scrapy
cd paper_scraper
# https://docs.scrapy.org/en/latest/intro/tutorial.html#how-to-run-our-spider
scrapy crawl semantic_scholar

Do not mess with DOWNLOAD_DELAY in settings.py, it keeps you out of trouble.

About

License:MIT License


Languages

Language:Python 100.0%