Aavache / LLMWebCrawler

A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Aavache/LLMWebCrawler Stargazers