data-collection
There are 16 repositories under data-collection topic.
NaiboWang / EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
Language:JavaScript 21454airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Language:Python 13999- snowplow
snowplow / snowplow
The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
Language:Scala 6734 - cloudquery
cloudquery / cloudquery
The open source high performance ELT framework powered by Apache Arrow
Language:Go 5585 - jitsu
jitsucom / jitsu
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
Language:TypeScript 3843 - Plan
plan-player-analytics / Plan
Player Analytics plugin for Minecraft Server platforms - View player activity of your server with ease. :calendar:
Language:Java 801 getodk / collect
ODK Collect is an Android app for filling out forms. It's been used to collect billions of data points in challenging environments around the world. Contribute and make the world a better place! ✨📋✨
Language:Java 698- augur
chaoss / augur
Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/ and learn more about Augur at our website https://augurlabs.io
Language:Python 570 pnoker / iot-dc3
IoT DC3 is an open source, distributed Internet of Things (IoT) platform based on Spring Cloud. It is used for rapid development of IoT projects and management of IoT devices. It is a set of solutions for IoT system.
Language:Java 455zhaoyachao / zdh_web
大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批流,私域营销等模块
Language:Java 408ScriptSmith / reaper
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Language:Python 355Smartproxy / Smartproxy
HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.
Language:C# 299- Language:TypeScript 281
wq / wq
📱🌐📋 wq: a modular framework supporting web / native apps for mobile surveys and geospatial data collection. Powered by Django REST Framework, Redux, React, and Material UI.
Language:JavaScript 254alibaba / android_viewtracker
A data collection library for click and exposure event with the UI.
Language:Java 237K3V1991 / Disable-Firefox-Telemetry-and-Data-Collection
How to disable Firefox Telemetry and Data Collection
silverton-io / buz
Serverless multi-protocol + multi-destination event collection system.
Language:Go 177- library
chapmanjacobd / library
An index for your archive. 70+ CLI tools to help you build, browse, and manage your media library.
Language:Python 158 madhavmk / Noise2Noise-audio_denoising_without_clean_training_data
Source code for the paper titled "Speech Denoising without Clean Training Data: a Noise2Noise Approach". Paper accepted at the INTERSPEECH 2021 conference. This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples.
Language:Jupyter Notebook 156MobileRoboticsSkoltech / OpenCamera-Sensors
Android app for synchronized recording of video and IMU data with advanced camera options, useful for 3D reconstruction, SLAM, AR, video stabilization. Supports remote control over network.
Language:Java 155💻📱 wq's app library: a JavaScript framework powering offline-first web & native apps for geospatial data collection, mobile surveys, and citizen science. Powered by Redux, React, Material UI and Maplibre GL.
Language:JavaScript 116- classifai
CertifaiAI / classifai
:fire: One of the most comprehensive open-source data annotation platform.
Language:Java 115 ☁🌐 wq's db library, extending Django REST framework to support apps for geospatial field data collection, citizen science, and crowdsourcing.
Language:Python 113- build
ODK Build is a drag-and-drop form designer for ODK XForms. Thousands of users around the world depend on it for their data collection campaigns. Contribute and make the world a better place! ✨📝✨
Language:JavaScript 110 bps-statistics / form-gear
FormGear is a framework engine for dynamic form creation and complex form processing and validation for data collection.
Language:TypeScript 106fabianoriccardi / ESPLogger
An Arduino library providing a minimal interface to log data on flash memory and SD cards with ESP8266 and ESP32.
Language:C++ 80Minipada / ros2_data_collection
Collect, validate and send data reliably from ROS 2 to create APIs and dashboards.
Language:C++ 73- Language:Nunjucks 69
- Language:Java 66
OpenCOVID19CoughCheck / CoughCheckApp
Development of AI audio app to compare the cough of a Coronavirus (COVID-19) infected individual with the cough of an uninfected individual.
Language:JavaScript 65mxdldev / android-amap-track-collect
这阵子由于项目需要，需要从手机上采集用户的运动轨迹数据，这样的功能大家都见到的很多了，比如咕咚、悦动圈，对跑步运动轨迹数据进行采集，再如，微信运动、钉钉运动，对于每一天你走步进行计数，如果要记录轨迹就离不开的手机定位，如果要记录步数那就离不开陀螺仪（角速度传感器），花了一天多的时间实现了一个定位数据实时采集的功能。
Language:Java 63pantunes / xtcryptosignals
Cryptocurrencies price data collection, price tickers, signals notifications, charts, Telegram bot and more.
Language:Python 62- Language:Python 61
- Goblyn
loseys / Goblyn
Goblyn is a Python tool focused to enumeration and capture of website files metadata.
Language:Python 61 ODK Briefcase is a Java application for fetching and pushing forms and their contents. It helps make billions of data points from ODK portable. Contribute and make the world a better place! ✨💼✨
Language:Java 60
