Big-Data's repositories
django-simple-import
An import tool easy enough your users could use it
elastic.js
A JavaScript implementation of the elasticsearch Query DSL
elasticsearch-kopf
web admin interface for elasticsearch
VisualSedimentation
Visual sedimentation is a novel design metaphor that progressively generates and updates visualizations of streaming data, inspired by the process of physical sedimentation. This process is the result of objects falling due to gravity forces, that aggregate into compact layers over time. The process is well understood since our environment is shaped by sedimentation: mountains, hills or rivers are the visible result of this long process.
Wappalyzer
Cross-platform utility that uncovers the technologies used on websites.
awesome-web-scraping
List of libraries, tools and APIs for web scraping and data processing.
benchmark.js
A benchmarking library that works on nearly all JavaScript platforms, supports high-resolution timers, and returns statistically significant results. As used on jsPerf.com.
bigdesk
Live charts and statistics for Elasticsearch cluster.
caravel
Caravel is a data exploration platform designed to be visual, intuitive, and interactive
crowdata
Easily crowdsource the analysis of your documents
django-debug-toolbar
A configurable set of panels that display various debug information about the current request/response.
django-report-builder
A GUI for Django ORM. Build custom queries and display results. Targets sys admins and capable end users who might not be able to program.
django-responsive-dashboard
A generic and easy dashboard for Django applications.
elasticsearch-inquisitor
Site plugin for Elasticsearch to help understand and debug queries.
encuestame
Encuestame is an open source CMS to make several type of surveys, based on massive distribution on social network, email, web and mobile versions, geolocation features, syndication, graphs, beautiful email templates and a modern user interface.
hon-lucene-synonyms
Solr query parser plugin that performs proper query-time synonym expansion.
linux-dash
A drop-in, low-overhead monitoring web dashboard for a linux machine.
neural-enhance
Super Resolution for images using deep learning.
platform.js
A platform detection library that works on nearly all JavaScript platforms.
portia
Visual scraping for Scrapy
pyspider
A Powerful Spider System with Web UI
rexster
A Graph Server
social_scrapers
Various Python scripts to scrape sites that store data about you.
tabula-extractor
Extract tables from PDF files
Zillow-Scraper
Zillow Scraper crawl data and get information related to real estate, apartments, mortgages, school data, and home improvement ideas. can automatically scrape data from web pages and save the scraped content in different formats. This is a free version of Zillow Scraper. To get the commercial version, please visit: