modrzew / malusers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

malusers

Go scraper created to answer the ancient question: who has the biggest power level?

Uses PuerkitoBio/goquery for parsing DOM and jinzhu/gorm for database manipulation.

Installation

  1. Clone:

    git clone git@github.com:modrzew/malusers
    cd malusers
    
  2. Build Go code:

    go get ./...
    go build ./...
    
  3. Build JS code:

    cd web
    npm install
    npm run build
    
  4. Copy config.json.example to config.json and fill it with connection values to your Postgres database.

Running

There are three CLI commands that can be run: malapi, maldata and malscraper, as well as web page.

All of them will read config.json, and use the same database.

malapi

API for the web application.

maldata

Used to process data in the database: create ranking table, as well as global statistics.

malscraper

Fetches users' data from the Internet.

Web page

Production

After running npm run build, production bundle will be placed in build folder.

Development

Run npm run start.

About

License:MIT License


Languages

Language:JavaScript 48.9%Language:Go 28.6%Language:TypeScript 17.1%Language:CSS 3.9%Language:HTML 1.5%