SunDevilThor's repositories
Apple-Careers
Scrapes job postings from jobs.apple.com and outputs to CSV file.
PyGoogleNews
Uses the pygooglenews library to scrape data from Google News
Sitemaps
Uses Requests and BS4 to scrape the sitemap of a demo website.
Request_Sessions
Uses Requests Session to speed up webscraping.
Woocommerce
Scrapes barefootbuttons site using Requests-HTML and outputs data to CSV file.
Amazon-ASINs
Scrapes Amazon ASINs from a Search Page.
CSS-Selectors
CSS Selectors for Requests-HTML - Scraping techniques
Movie-Quotes-Sentiment
Uses IMDbPY library to get movie information - particular movie quote sentiment
Amazon-Price-Tracker
Amazon price tracker for select ASINs and inputs data into SQLite3 Database.
AmazonReviews-Splash
Uses Splash to scrape Amazon Reviews for given URL.
Splash-JS
Utilizes Splash to render pages and BeautifulSoup to parse the HTML.
Quotes-JS
Uses Selenium and BeautifulSoup to load headless browser and render Javascript to scrape content.
StackOverflow
Scrapes recent active questions on StackOverflow based on a given Tag.
HTML-to-Pandas
Demonstrates the read_html function in the Pandas library. Scrapes tables directly from HTML source.
Yellow-Pages
Scrapes the Yellow Pages site in the UK and looks for Coffee Shops near London. Outputs data into CSV file.
AFL-Stats-Table
Scrapes table data from AFL-Stats website.
MozillaBlog
Scrapes all blogs from the Mozilla website.
BeerWulf
Scrapes beer name, info, price, rating, and stock availability from the BeefWulf website.
HelmBoots-Shopify
Scrapes data from HelmBoots websites and puts the data into a Pandas DataFrame and CSV file
BestBuy_CPU_BS
Best Buy Scraper for RTX 3080 GPUs using BeautifulSoup
BestBuy_GPU_BS
Best Buy Scraper for RTX 3080 GPUs using BeautifulSoup
whiskyscraper
Scrapy project to webscrape the WhiskyShop website and list out the different names of whisky with prices and links
CollatzSequence
Collatz Sequence