comenix

android-testing

A collection of samples demonstrating different frameworks and techniques for automated testing

Autohome

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

awesome-crawler

A collection of awesome web crawler,spider in different languages

awesome-wechat-weapp

微信小程序开发资源汇总 :100:

Douban_Crawler

Uno Crawler por https://douban.com

faiss

A library for efficient similarity search and clustering of dense vectors.

frontend

git-repo

GPlayCrawler

instagram-php-scraper

Instagram PHP Scraper. Get account information, photos, videos, stories and comments.

isotope

:revolving_hearts: Filter & sort magical layouts

jd_spider

两只蠢萌京东的分布式爬虫.

magnet-uri

Parse a magnet URI and return an object of keys/values

meizi_spider

scrapy demo

modular-admin-html

Modular Admin - Free Dashboard Theme Built On Bootstrap 4 | HTML Version

NewsScrapy

基于scrapy的新闻爬虫

parse-torrent-file

Parse a .torrent file and return an object of keys/values

PttImageSpider

PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)

react-native-dribbble-app

Dribbble app built with React Native

scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

scrapy-crawl-once

Scrapy middleware which allows to crawl only new content

scrapy-crawlera

Crawlera middleware for Scrapy

scrapy-elasticsearch

A scrapy pipeline which send items to Elastic Search server

scrapy-examples

Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.

scrapy-mongodb

Mongodb support for scrapy

ScrapyProject

scrapy爬取豆瓣电影top250

socket.io-redis

Adapter to enable broadcasting of events to multiple separate socket.io server nodes.

startbootstrap-clean-blog-jekyll

A Jekyll version of the Clean Blog theme by Start Bootstrap

web-pull-to-refresh

A native-like JavaScript pull to refresh implementation for the web.

WebHubBot

Python + Scrapy + MongoDB . 5 million data per day !!!💥 The world's largest website.