nitharios / souppyer

An ambitious little web scraper

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

souppyer

Purpose

This app was built to develop my skills as a Python developer. At its core, this is a web scraper.

Installation

Built with Python3

  1. Fork and clone
  2. cd souppyer
  3. Follow the virtualenv steps here
  4. pip install -r requirements.txt
  5. mkdir data
  6. Open app.py and comment out the lines where instructed to
  7. python app.py
  8. Check out what you scraped data/data.txt

Issues

403 Forbidden

SSL: CERTIFICATE_VERIFY_FAILED

Tools

Beautiful Soup

virtualenv

Resources

20+ Web Scraping Examples

Automate the Boring Stuff

How to Work with virtualenv

Introduction to Web Scraping (with Python and Beautiful Soup)

License

MIT License

About

An ambitious little web scraper

License:MIT License


Languages

Language:Python 100.0%