ksahin / awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

Awesome Web Scraping

The list of tools, programming libraries and web services used in web scraping and data processing.

Web scraping chats: @grablab (English) and @grablab_ru (Russian)

Programming Libraries

• Python
• PHP
• Ruby
• JavaScript
• Go

Other Things

• Web Scraping Services
• Console tools
• dhamaniasad / HeadlessBrowsers - a list of (almost) all headless web browsers in existence
• DNS over HTTPS providers - list of DNS over HTTPs providers

Captcha Solving Services

• 2captcha.com - 2captcha.com
• anti-gate.com - anti-gate.com

Contributing

See Contributing document.

Credits

The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript