Lazar-T / alexa_spider

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

alexa_spider

About

Spider built with Scrapy. Crawls first 50k ranked websites currently on alexa.com and scrapes data points such as:

  • Country of Rank
  • Rank Number
  • Search Visits
  • Domain

Screenshot

Screenshot

Installation and Running

git clone https://github.com/Lazar-T/alexa_spider
cd alexa_spider
scrapy crawl alexa

About

License:MIT License


Languages

Language:Python 100.0%