illusionTBA / AniMappings

A project to scrape anime meta from lots of websites using anilist id's

AniMappings

A project to scrape anime meta from lots of websites using anilist id's

Technologies Used

• Node.js
• TypeScript
• Prisma

Getting Started

Prerequisites

A Postgresql database needs to already be setup. You can use Neon.tech, Planetscale and Railway. They offer amazing free tiers that you can utilize

Installation

1. Clone the repository: git clone https://github.com/illusionTBA/AniMappings.git
2. Install dependencies: npm install
3. Make a .env file with a variable called DATABASE_URL and set it to your Postgresql connection URL string.

DATABSE_URL="postgresql://user:password@host/db"

4. crawl anilist to populate DB: npm run crawl
5. Start the server: npm start

Usage

• You can export all of the DB into a json file using the npm run export command
• Using the webserver (npm start) you can request the /anilist/id route to recieve the meta for that anime (replacing id with the anilist id)
• Crawling is how the database populates itself. You can use npm run crawl to start crawling anilist and other providers. If it crashes it will start off where it left off.

Acknowledgements

• Mr Ethical Integrated the lastId feature.
• Eltik Inspired me to do this project with his AniSync Project.