A web scraper that can be used to scrape French expressions from www.linternaute.fr.
urllibbs4(BeautifulSoup)restring
There are three principal functions in this code:
scrape_site()scrape_letter()scrape_page()
Each of them will return a list of French expressions scraped from the site.
scrape_site() takes no arguments and will scrape the entirety of the site.
scrape_letter() takes one letter as an argument (e.g., 'a', 'k', 'x', etc.) and scrapes every French expression that begins with that letter.
scrape_page() takes two arguments: a letter and a positive integer (e.g., 1, 3, 101, etc.). The letter and the integer correspond to a page on the website (e.g., scrape_page('q', 2) would scrape all of the expressions found on this page).