yaoxy2010 / arxiv_paper_downloader

Arxiv daily paper downloader and manage papers with markdown preview.

arxiv paper downloader

env

pip install -r requirements.txt

Windows system meets pdf2image related errors, see issue_markdown for solution.

usage

Download Arxiv papers

Download the latest n day research paper PDF, generate corresponding markdown and preview images.

python arxiv_spider.py  --root_dir  /your/papers/dir/path  --days n

If you want to overwrite previous markdowns, use

python arxiv_spider.py  --root_dir  /your/papers/dir/path  --days n  --overwrite

todo

• Maintain an index database of all papers for quick search and reference.
• Highlight target conferences and authors.
• Highlight custom keyword list.
• Customize the specific areas of interest, such as CS.CL and CS.CV.
• Demo videos.
• Use VPN Arg Parse.

Useful Arxiv Related Repos

• https://github.com/lukasschwab/arxiv.py
• https://github.com/braun-steven/arxiv-downloader

Download ACL papers

This repo also support acl anthology papaer download.

Step 1: download all papers, default is ACL 2023 papers, you can specify your acl url.

python acl_spider.py

Step 2: filter papers according to your keywords, and get the abstract of every paper.

python filter_papers.py --keywords keyword1 keyword2 keyword3