node-crawler

There are 4 repositories under node-crawler topic.

• BruceDone / awesome-crawler

  A collection of awesome web crawler,spider in different languages

  web-crawlercrawlerweb-scraperspidernode-crawlerscraperawesome
  6950

• poozhu / crawler-for-github-trending

  🕷️ A node crawler for github trending.

  crawlernode-crawlergithub-trending
  Language:JavaScript 183

• omkarcloud / botasaurus-starter

  🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖

  beautifulsoupcrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolheadlessnode-crawlerpython-crawlerscraperscrapingscraping-frameworkscraping-pythonscraping-toolseleniumweb-crawlerweb-crawlingweb-scraperweb-scrapingwebscraping
  Language:TypeScript 29

• MertenD / node-crawler

  Node-Crawler is a highly customizable, Node-based web application for creating web crawlers and further processing and transforming the retrieved data.

  enginenextjsnode-basedreactflowwebcrawlernode-crawlertools
  Language:TypeScript 24

• zcrossoverz / manga-lib

  manga-lib is a nodejs library that allows you to easily scrape manga content from various websites.

  mangamanga-crawlermanga-librarymanga-scrapermanga-scrappernettruyennodejs-crawlernode-crawlertoonilyasurascansblogtruyen
  Language:TypeScript 17

• sarthology / criCLI

  🏏 Small CLI app to show Live Score of Cricket matches in Terminal

  clicommand-line-appcommand-line-toolcommanderjscricketnode-crawlerterminal
  Language:JavaScript 16

• xikong1995 / node-crawler

  nodejs 爬虫，包括不限于微博，instagram，图片和视频

  node-crawler
  Language:JavaScript 13

• omkarcloud / web-scraping-template

  🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖

  beautifulsoupcrawlercrawlingcrawling-frameworkcrawling-pythoncrawling-toolheadlessnode-crawlerpython-crawlerscraperscrapingscraping-frameworkscraping-pythonscraping-toolseleniumweb-crawlerweb-crawlingweb-scraperweb-scrapingwebscraping
  Language:Python 8

• AppliedSoul / promise-crawler

  Promise support for node-crawler (Web Crawler/Spider for NodeJS + server-side jQuery)

  crawlernode-crawlernodejsspiderpromise-node-crawler
  Language:JavaScript 6

• onibus-gv / onibus-gv-crawler

  Crawler para pegar horários dos ônibus da grande vitória

  crawlernode-crawlerjavascriptnodetransportceturbsanremotranscolvitoriaapibusonibus
  Language:JavaScript 6

• zhangwinning / crawler_poster

  node crawler

  node-crawler
  Language:JavaScript 6

• 52cik / creeper

  简单爬虫引擎 (苦力怕)

  crawlernode-crawler
  Language:JavaScript 5

• canyuegongzi / simple-crawlers-center

  基于node的爬虫系统，定时爬取实时热点 ，新闻，存入mongodb

  nodenode-crawlernode-scheduletypescript
  Language:TypeScript 5

• omkarcloud / dentalkart-scraper

  🚀 SCRAPE 1000'S OF PRODUCTS FROM DENTALKART 🤖

  beautifulsoupcrawlercrawlingcrawling-frameworkcrawling-pythonnode-crawlerscraperscrapingscraping-frameworkscraping-pythonseleniumweb-crawlerweb-crawlingweb-scraperweb-scrapingwebscrapingdentalkartdentalkart-product-scraperdentalkart-scraperdentalkart-scraping
  Language:Python 2

• AkashRajpurohit / node-crawler

  Nodejs Crawler which scrapes a website on live domain and crawls to find all URL of the domain

  crawlernode-crawlernodejsurl
  Language:JavaScript 1

• coooold / PHPCrawler

  Most powerful, popular and production crawling/scraping package for PHP

  phpcrawlernode-crawlerampcoroutine
  Language:PHP 1

• derekeeeeely / dz-pjs

  collection of old pjs

  reactdvadjangokongtypescriptparcelmobxpuppeteerpandoranode-crawlerrustgolangnuxtvuereact-dnd
  Language:JavaScript 1

• m98 / email-extractor-crawler

  A minimal Node crawler to find emails used inside a website content, this crawler follows links in the website and tries to find an email in the content of the page

  crawlerscraperemailnodejsjavascriptnode-crawlerlowdb
  Language:JavaScript 1

• adiled / adene-bot

  Energy Certificates Crawler and Scraper

  node-crawlernodejs-bot
  Language:JavaScript 0

• lossless1 / image_crawler

  Crawl all images from any website

  nodejavascriptnode-crawler
  Language:JavaScript 0

• lsongdev / node-crawler

  simple crawler

  crawlernode-crawler
  Language:JavaScript