This is a codebase for a scraper that extracts data from your favourite Shopify stores and compiles them into a detailed database. The scraper can extract hundreds or even thousands of products from a store's database, making it easier to keep track of new products and changes in inventory.
- Extracts product data including variant id, id, title, date published, product type, vendor, variant title, sku, price, if available or not, date created, date updated, comparing at price.
- Saves data to a database for easy access and searchability.
- Can scrape multiple pages of a store's database.
- Users can choose their favourite shopify store to scrape.
- Python 3.x
requestslibrarydatasetlibraryjsonlibrary
- Clone the codebase to your local machine
- Install the required libraries stated above in your terminal
- Download
SQLite DB Browserto have a better view of the products - Run the scraper by running
python main.pyin your terminal - The data will be saved to a database file in the same directory
- This scraper is intended for personal use only and should not be used for commercial purposes.
- Use of this scraper may violate Shopify's term of service. Use at your own risk.
- This codebase was developed by me and was inspired by the need to easily track new products on Shopify stores.
- This project is licensed under the MIT License. See the
LICENSEfile for details
- This scraper provides an easy and efficient way to keep track of new products on your favourite Shopify stores. By using this scraper, you can save time and stay up-to-date with the latest products without the hassle of constantly checking the store's website.