zeroproduct / grail-fits-scraper

Scrape images and titles from Grail Fits articles

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

grail-fits-scraper

Needed a bunch of outfit images as seed data for a separate project. Uses puppeteer to crawl and fetch images from Grail Fits articles (ex: https://www.grailed.com/drycleanonly/grail-fits-131). Exports a fits.json file with structure described below.

How to run

$ cd grail-fits-scraper
$ npm install
$ npm run scrape -- <range> 
# ex: 100-120, defaults to 130-131

Generates fits.json in src/

{
  "data": [
    { 
      "title": "user1", 
      "src": "srcToImg1"
    },
    { 
      "title": "user2", 
      "src": "srcToImg2"
    }
  ],
  "error": ""
}

About

Scrape images and titles from Grail Fits articles

License:MIT License


Languages

Language:JavaScript 100.0%