alexthegoodman / rapid-search

Web Search and Crawler - Node.js Worker Threads, Flask API, Huggingface Transformers

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

RapidSearch

Alt text

RapidSearch is a web crawler and collection of APIs. It is designed to digest and analyze pages using open-source machine learning models, and then make these pages available via a GraphQL interface.

  • Crawler uses Node.js Workers, Prisma, Puppeteer, and Cheerio
  • GraphQL API uses Prisma and Nexus
  • Scoring API uses Flask, Flask-RESTful, and SpaCy

About

Web Search and Crawler - Node.js Worker Threads, Flask API, Huggingface Transformers


Languages

Language:TypeScript 54.8%Language:JavaScript 25.5%Language:Python 17.0%Language:SCSS 2.7%