distributed-scraper

There are 2 repositories under distributed-scraper topic.

• MorvanZhou / easy-scraping-tutorial

  Simple but useful Python web scraping tutorial code.

  asynciobeautifulsoupcrawlercrawlingdistributed-scraperregexrequestsscrapingscrapyurllib
  Language:Jupyter Notebook 766
• google-maps-scraper

  gosom / google-maps-scraper

  scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

  golanggoogle-maps-scrapingweb-scraperweb-scrapingdistributed-scraperdistributed-scrapinggoogle-maps
  Language:Go 651

• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI

  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

  scrapyrabbitmqmongodbpythonscrapyddjangodistributed-crawlerdistributed-scraperscrapy-ui
  Language:Python 110

• nemo / scrape

  Distributed Scraper

  scraperdistributed-scrapermetadatastdlib
  Language:JavaScript 65

• queue-xec / master

  Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper

  processingdistributed-computingqueuedynamic-code-executionnodejspush-workdistribute-jobtask-runnerpeer2peerdistdistributed-computationdistributed-scraperdistributed-scrapingserverless-distributed-computing
  Language:JavaScript 10

• ZhuoYitao / poems

  基于Scrapy的分布式爬虫，用于抓取诗词

  scrapyredisaliclouddistributed-scraper
  Language:Python