gughog / smtiv-webscrapper-tool

A web scrapper to scrape data from a smt iv related website.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SMT IV Webscrapper Tool

This is a NodeJS tool made along with puppeteer to training Web Scrapping concepts. It scrapes some data from the game Shin Megami Tense IV and Shin Megami Tensei IV: Apocalypse from sites on the web.

Functionalities:

  • Scrapes and creates a JSON file and a SQL Script with data;
  • Formats all data into a customizable format;
  • Makes me get some fun learning useful concepts with themes i like, such as SMT.

TODO: (SMTIV)

  • Scrape creatures
  • Scrape skills
  • Scrape Apps
  • Scrape Special Fusions

TODO: (SMTIV:A)

  • Scrape and make a sign on SMTIV:A exclusives and missing demons
  • Scrape and make a sign on SMTIV:A exclusives and missing skills
  • Scrape and make a sign on SMTIV:A exclusives and missing apps
  • Scrape and make a sign on SMTIV:A exclusives and missing special fusions

About

A web scrapper to scrape data from a smt iv related website.


Languages

Language:JavaScript 100.0%