AlphaReign Scraper
AlphaReigns DHT Scraper, includes peer updater and categorizer
More Info Here: https://github.com/AlphaReign/AlphaReign
Notes
This scrape relies on storing the torrent data in a database. I recommend either mariadb or mysql. It will work with sqlite if you wish to have a portable database but doing so will require a high level of disk usage as sqlite writes to a single file.
Installation
- Download or clone the repository
- Install node (Version 8 Required. Higher versions might work)
- Install yarn
- Install elasticsearch
- Install mysql / mariadb / sqlite
- Install pm2 globally (
yarn global add pm2) - Update config/index.js (ElasticSearch variables if on a different host, Database variables)
- Run yarn (
yarn) - Run yarn migrate (
yarn migrate) - Start pm2 with Ecosystem file (
pm2 start ecosystem.config.js)
Updating
- Stop running pm2 instances (
pm2 stop all) - Download or pull the repository
- Run yarn migrate (
yarn migrate) - Start pm2 (
pm2 start all)
Docker
- Build the image:
docker build -t alphareign/scraper:latest . - Update
config/index.js(Elasticsearch & Database may be on e.g. 172.17.0.1) - Run
yarn migrate:docker run --rm -v $(pwd)/config/index.js:/scraper/config/index.js alphareign/scraper:latest yarn migrate - Start the scraper:
docker run -d --name alphareign-scraper -v $(pwd)/config/index.js:/scraper/config/index.js -p 6881:6881/udp alphareign/scraper:latest