aashishpanthi / web-crawler

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Web-crawler

This is a web crawler made using puppeteer library in javascript. It visists different websites, scrapes the information and stores the information inside of a database which can be accessed by the search engine.

About

License:MIT License


Languages

Language:JavaScript 99.8%Language:Shell 0.2%