BarbarianTarkus / FitGirl-Scrap-Web

FitGirl Web Application with Svelte for Frontend, Rust for Scrapping and Redis for DB

Home Page:https://fitgirl.barbariantarkus.duckdns.org/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

FitGirl-Scrap-Web

Preview

webpagestate

Future addtions

Dev:

  • Pagination(Very bad use of memory for the moment) 📖
  • Search bar 🔎
  • Use redis caché for optimize navigation, query's...
  • Pagination
  • Automate Scrapping Process 🕷️🕸️
  • Connection to a VideogameDB API 🖥️ This is for add fuctionality like
    • Advanced Filtering ✔️✖️
      • Order, filter, by compression ratio
      • Online, Coop, Single player features
      • Genre
      • Stats(Times Viewed, Downloaded, Game Scores)
    • Like, Dislike 👍
  • Add native comments 💭

Production:

  • Unofficial Fitgirl Repacks API

Build

1. Docker compose (Redis DB)

docker compose up -d

2. Rustcrap(Web Scrapper)

Needs a redis server running Crawls every page of the official website and saves to the redis DB

cd rustcrap/
cargo build
cargo run
  • By the moment it needs to be launched manually

Debugging Web App

Frontend developed with SvelteKit

  • Gets all the data from DedisDB with the package ioredis
cd web/
npm i
npm run dev

⚡⚡ DISCLAIMER⚡⚡

This is for only for educational purposes. 📚

About

FitGirl Web Application with Svelte for Frontend, Rust for Scrapping and Redis for DB

https://fitgirl.barbariantarkus.duckdns.org/


Languages

Language:Svelte 28.2%Language:TypeScript 26.1%Language:Rust 22.0%Language:JavaScript 11.6%Language:CSS 6.9%Language:Dockerfile 3.3%Language:HTML 1.9%