DitmirH / Webretriever

Scrapes websites and returns you with some options

WebRetriever

Retrieves links, tags and text from any given webpage

Pre-requesites :

• You need to ensure you have BeautifulSoup installed on your machine. You can do this with the following commands:

$ easy_install beautifulsoup4 or $ pip install beautifulsoup4

Further reading : https://www.crummy.com/software/BeautifulSoup/bs4/doc/

• You also need to import urllib2 , this is already in the code

Webretriever has a few options to scrape all links on the page , all tags and text where visible.

• Instructions:

1. Run the script using python webRetriever.py
2. Enter your url when prompted
3. Select from the options