archae0pteryx / semiai-crawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

SemiAI crawler

A web spider to crawl without being squished

  1. Fill out crawler.config.json
  2. Build image docker build -t semiai-scraper .
  3. Run container docker run semiai-scraper

About


Languages

Language:TypeScript 97.5%Language:Dockerfile 1.8%Language:JavaScript 0.7%