Go scraper created to answer the ancient question: who has the biggest power level?
Uses PuerkitoBio/goquery for parsing DOM and jinzhu/gorm for database manipulation.
-
Clone:
git clone git@github.com:modrzew/malusers cd malusers
-
Build Go code:
go get ./... go build ./...
-
Build JS code:
cd web npm install npm run build
-
Copy
config.json.example
toconfig.json
and fill it with connection values to your Postgres database.
There are three CLI commands that can be run: malapi
, maldata
and malscraper
, as well as web page.
All of them will read config.json
, and use the same database.
API for the web application.
Used to process data in the database: create ranking table, as well as global statistics.
Fetches users' data from the Internet.
After running npm run build
, production bundle will be placed in build
folder.
Run npm run start
.