data-platform

There are 11 repositories under data-platform topic.

• odd-platform

  opendatadiscovery / odd-platform

  First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

  ossdata-platformmetadatametadata-managementdata-pipelinesdata-engineeringobservabilitydata-catalogdatacatalogdata-discoverydata-lineagebigdataalertinglineagedata-profilingdata-explorationdata-governancedata-qualitydata-sciencedata-observability
  Language:Java 1120

• stitchfix / hamilton

  A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton

  dagdata-engineeringdata-platformdata-sciencedataframeetletl-frameworketl-pipelinefeature-engineeringfeaturizationhamiltonhamiltonianmachine-learningnumpypandaspythonsoftware-engineeringstitch-fix
  Language:Python 873

• meltwater / served

  A C++11 RESTful web server library

  datasiftdata-platform
  Language:C++ 710

• flowerfine / scaleph

  Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.

  data-platformdataopsdagseatunnelflinkflink-sqlflink-sql-gatewayflink-kubernetesflink-kubernetes-operatordorisdoris-operatordoris-manager
  Language:Java 334

• jay86cn / techui-vue2

  TechUI is a easy to use Dynamic SVG Data Visualization Dashboard development tool, based on vite + vue2 development

  dashboardhigh-tech-uitechuisvg-uidashboard-applicationdashboard-templatesdynamic-svghigh-tech-dashboardsvg-designsdata-analysisdata-applicationdata-platformdata-viewerdata-visualizationchartechartsvitevue2vue3
  Language:Vue 200

• mapbox / ecs-watchbot

  Make robots do your work for you

  data-platformcloudformation-helpers
  Language:JavaScript 194

• src-d / sourced-ce

  source{d} Community Edition (CE)

  dashboardsdata-analysisdata-visualizationchartsdata-miningdata-platformgitgithubmetricssql
  Language:Go 184

• silverton-io / buz

  Serverless multi-protocol + multi-destination event collection system.

  redpandajsonschemacloudeventswebhook-receiverwebhook-servercontractseventbridgeredpanda-consoleanalytics-trackinganalyticsdatadata-collectionproduct-analyticssnowplow-analyticscloudevents-schemadata-platformschema-registryschema-validationstreaming-analyticsstreaming-data
  Language:Go 177

• Azure / data-management-zone

  Template to deploy the Data Management Zone of Cloud Scale Analytics (former Enterprise-Scale Analytics). The Data Management Zone provides data governance and management capabilities for the data platform of an organization.

  enterprise-scalearmazurearchitecturepolicy-drivendata-platformbicepdata-meshdata-fabricenterprise-scale-analyticsdatamesh
  Language:Bicep 165

• Azure / data-landing-zone

  Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Landing Zone is a logical construct and a unit of scale in the architecture that enables data retention and execution of data workloads for generating insights and value with data.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdatamesh
  Language:Bicep 158
• opendatadiscovery-specification

  opendatadiscovery / opendatadiscovery-specification

  ODD Specification is a universal open standard for collecting metadata.

  specificationspecopen-sourcebig-databig-data-platformdata-meshapidata-engineeringdata-discoveryopensourcedata-platformmetadatametadata-managementmetadata-parserdata-governance
  117
• atrocore

  atrocore / atrocore

  AtroCore is an open-source Data Platform, Data Management and Master Data Management (MDM) software, which can be used to quickly create any business application.

  business-applicationbusiness-application-platformenterprise-applicationenterprise-application-platformradrapid-application-developmentmdmmaster-data-managementdata-managementdata-management-platformdata-platformbusiness-appdata-management-systembusiness-apps
  Language:JavaScript 101

• blueapron / kafka-connect-protobuf-converter

  Protobuf converter plugin for Kafka Connect

  kafkakafka-connectprotocol-buffersprotobuf-converterjardatadata-platformprotobuf
  Language:Java 94

• taogeYT / pyetl

  python ETL framework

  pythonetleshiveexportcsvexcelmysqlsqlserverdboraclesqletl-processdata-analyticsdata-platformdata-pipeline
  Language:Python 90

• ssimunic / Temp-Monitor

  Internet of Things data platform for temperature and humidity sensors with maps

  iot-platformiotinternet-of-thingsdata-platformtemperaturehumidity
  Language:PHP 89

• anna-geller / prefect-dataplatform

  Example repository showing how to build a data platform with Prefect, dbt and Snowflake

  analyticsanalytics-engineeringautomationdata-engineeringdata-platformdbtpythonsnowflakesqldata-warehousingdataflowdataflow-opsorchestrationprefect
  Language:Python 81

• jay86cn / techui-vue3-lite

  A free, simple, and easy-to-use technology-style UI component, developed based on vue3

  dashboardtechuihigh-tech-uidashboard-applicationdashboard-templatesdynamic-svghigh-tech-dashboardsvg-uidata-analysisdata-applicationdata-platformdata-viewerdata-visualizationbig-datachartechartsvitevue3datavvuedata
  Language:Vue 78

• Graviti-AI / tensorbay-python-sdk

  Graviti TensorBay Python SDK

  datasettensorbaygravitipythondata-platform
  Language:Python 75

• Azure / data-product-analytics

  Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to create insights and products for external users.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivendata-meshdata-fabricbicepenterprise-scale-analyticsdata-product
  Language:Bicep 72

• linktimecloud / kubernetes-data-platform

  KDP(Kubernetes Data Platform) delivers a modern, hybrid and cloud-native data platform based on Kubernetes.

  bigdatacloud-nativedata-platformk8skubernetes
  Language:CUE 69

• fabioms-br / estudados

  Banco de Dados para Estudo

  azureazure-sqlazure-sql-databasedatadata-analysisdata-miningdata-platformdata-sciencedatabaselearningmicrosoftsql-serversql-server-databaset-sql
  64

• pracdata / awesome-open-source-data-engineering

  A curated list of open source tools used in analytical stacks and data engineering ecosystem

  awesomeawesome-listdata-analyticsdata-engineeringdata-platformdatabaseself-hostedmlopsdata-storagedatadata-integrationdata-lakehousedatalakelakehouseworkflow-engineanalyticsdata-warehouseobservabilitydata-pipelineetl
  55
• Shoonya

  AI4Bharat / Shoonya

  Shoonya - Platform to Annotate and label data at scale.

  annotationlabelingdata-platform
  46

• josephmachado / online_store

  End to end data engineering project

  python3data-engineeringdata-pipelinedagsterpostgresqldatawarehousedata-processingdata-platformdata-analysis
  Language:Python 44

• opendatadiscovery / odd-collector

  Open-source metadata collector based on ODD Specification

  data-catalogdata-discoverydata-governancedata-observabilitydata-platformdata-profilingdatacataloglineagedata-piplineshacktoberfest
  Language:Python 42

• Azure / data-product-batch

  Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 39

• Azure / data-product-streaming

  Template to deploy a Data Product for data stream processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 35
• data-platforms-tools

  ryandawsonuk / data-platforms-tools

  Guide to data platforms and tools

  azure-synapse-analyticsdata-warehousingbigquerydatabrickssnowflakedata-platformclouderadata-meshdata-governance
  31

• chumaky / docker-images

  Postgres database with different foreign data wrapper extensions installed. Datero data platform engine image.

  heterogeneous-sqlpostgresqlsqldaterodata-platformdata-virtualizationreverse-etlfdwforeign-data-wrapper
  Language:Shell 26

• rpj / rpi

  RPJiOS: RPJ's RPi OS, a sensor data platform for the Raspberry Pi built with python2.7 and redis.

  raspberry-pipythonsensorsredisrpigarden-botssensordata-streamdata-pipelinedata-platformdata-processing
  Language:Python 25

• govflow / govflow

  An open, modular work order and workflow management system for local government and residents.

  government311open-governmentopen-datadata-platformcrmcitiesmunicipalities
  Language:TypeScript 24

• davidgasquez / filecoin-data-portal

  🧮 Open and local-first data hub for Filecoin!

  data-analysisdata-platformfilecoin
  Language:Python 20

• MeltwaterArchive / quitsies

  A persisted drop-in replacement for Memcached, respecting the rules of quitsies.

  key-valuenosqlpersistentmemcachedrocksdbsnapshotdatasiftdata-platform
  Language:C++ 16

• related-sciences / articat

  articat: data artifact catalog

  data-platformdata-discoverydata-managementdata-catalog
  Language:Python 16

• Scout24 / emr-autoscaling

  data-platform
  Language:Python 16

• luatnc87 / open-source-modern-data-stack

  This repo demonstrate a comprehensive modern data stack using popular open-source tools.

  airbytedbtdorissupersetdata-platformdockerdocker-composemds
  Language:Shell 15