data-platform

There are 13 repositories under data-platform topic.

• odd-platform

  opendatadiscovery / odd-platform

  First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

  alertingbigdatadata-catalogdata-discoverydata-engineeringdata-explorationdata-governancedata-lineagedata-observabilitydata-pipelinesdata-platformdata-profilingdata-qualitydata-sciencedatacataloglineagemetadatametadata-managementobservabilityoss
  Language:Java 1194

• stitchfix / hamilton

  A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton

  pythonpandasdagdata-sciencedata-engineeringnumpysoftware-engineeringetl-frameworketl-pipelineetlfeature-engineeringfeaturizationdataframestitch-fixdata-platformhamiltonhamiltonianmachine-learning
  Language:Python 863

• meltwater / served

  A C++11 RESTful web server library

  data-platformdatasift
  Language:C++ 709

• flowerfine / scaleph

  Open data platform based on Kubernetes. Scaleph supports SeaTunnel、Flink and Doris backended by SeaTunnel on Flink engine、Flink Kubernetes Operator and Doris operator.

  data-platformdataopsdagseatunnelflinkflink-sqlflink-sql-gatewayflink-kubernetesflink-kubernetes-operatordorisdoris-operatordoris-manager
  Language:Java 365

• jay86cn / techui-vue2

  TechUI is a easy to use Dynamic SVG Data Visualization Dashboard development tool, based on vite + vue2 development

  chartdashboarddashboard-applicationdashboard-templatesdata-analysisdata-applicationdata-platformdata-viewerdata-visualizationdynamic-svgechartshigh-tech-dashboardhigh-tech-uisvg-designssvg-uitechuivitevue2vue3
  Language:Vue 213

• mapbox / ecs-watchbot

  Make robots do your work for you

  cloudformation-helpersdata-platformpriorityproduction
  Language:JavaScript 195

• silverton-io / buz

  Serverless multi-protocol + multi-destination event collection system.

  redpandajsonschemacloudeventswebhook-receiverwebhook-servercontractseventbridgeredpanda-consoleanalytics-trackinganalyticsdatadata-collectionproduct-analyticssnowplow-analyticscloudevents-schemadata-platformschema-registryschema-validationstreaming-analyticsstreaming-data
  Language:Go 186

• src-d / sourced-ce

  source{d} Community Edition (CE)

  chartsdashboardsdata-analysisdata-miningdata-platformdata-visualizationgitgithubmetricssql
  Language:Go 185

• Azure / data-management-zone

  Template to deploy the Data Management Zone of Cloud Scale Analytics (former Enterprise-Scale Analytics). The Data Management Zone provides data governance and management capabilities for the data platform of an organization.

  enterprise-scalearmazurearchitecturepolicy-drivendata-platformbicepdata-meshdata-fabricenterprise-scale-analyticsdatamesh
  Language:Bicep 169

• Azure / data-landing-zone

  Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Landing Zone is a logical construct and a unit of scale in the architecture that enables data retention and execution of data workloads for generating insights and value with data.

  architecturearmazurebicepdata-fabricdata-meshdata-platformdatameshenterprise-scaleenterprise-scale-analyticspolicy-driven
  Language:Bicep 165

• linktimecloud / kubernetes-data-platform

  KDP(Kubernetes Data Platform) delivers a modern, hybrid and cloud-native data platform based on Kubernetes.

  awesomeawesome-listbigdatadata-platformk8skubernetes
  Language:CUE 145
• opendatadiscovery-specification

  opendatadiscovery / opendatadiscovery-specification

  ODD Specification is a universal open standard for collecting metadata.

  specificationspecopen-sourcebig-databig-data-platformdata-meshapidata-engineeringdata-discoveryopensourcedata-platformmetadatametadata-managementmetadata-parserdata-governance
  128
• atrocore

  atrocore / atrocore

  AtroCore is an open-source Data Platform, Data Management and Master Data Management (MDM) software, which can be used to quickly create any business application.

  business-applicationbusiness-application-platformenterprise-applicationenterprise-application-platformradrapid-application-developmentmdmmaster-data-managementdata-managementdata-management-platformdata-platformbusiness-appdata-management-systembusiness-apps
  Language:JavaScript 112

• pracdata / awesome-open-source-data-engineering

  A curated list of open source tools used in analytical stacks and data engineering ecosystem

  awesomeawesome-listdata-analyticsdata-engineeringdata-platformdatabaseself-hostedmlopsdata-storagedatadata-integrationdata-lakehousedatalakelakehouseworkflow-engineanalyticsdata-warehouseobservabilitydata-pipelineetl
  109

• taogeYT / pyetl

  python ETL framework

  pythonetleshiveexportcsvexcelmysqlsqlserverdboraclesqletl-processdata-analyticsdata-platformdata-pipeline
  Language:Python 98

• blueapron / kafka-connect-protobuf-converter

  Protobuf converter plugin for Kafka Connect

  datadata-platformjarkafkakafka-connectprotobufprotobuf-converterprotocol-buffers
  Language:Java 94

• anna-geller / prefect-dataplatform

  Example repository showing how to build a data platform with Prefect, dbt and Snowflake

  analyticsanalytics-engineeringautomationdata-engineeringdata-platformdbtpythonsnowflakesqldata-warehousingdataflowdataflow-opsorchestrationprefect
  Language:Python 89

• jay86cn / techui-vue3-lite

  A free, simple, and easy-to-use technology-style UI component, developed based on vue3

  big-datachartdashboarddashboard-applicationdashboard-templatesdata-analysisdata-applicationdata-platformdata-viewerdata-visualizationdatavdynamic-svgechartshigh-tech-dashboardhigh-tech-uisvg-uitechuivitevue3vuedata
  Language:Vue 89

• ssimunic / Temp-Monitor

  Internet of Things data platform for temperature and humidity sensors with maps

  data-platformhumidityinternet-of-thingsiotiot-platformtemperature
  Language:PHP 88

• Graviti-AI / tensorbay-python-sdk

  Graviti TensorBay Python SDK

  data-platformdatasetgravitipythontensorbay
  Language:Python 76

• Azure / data-product-analytics

  Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to create insights and products for external users.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivendata-meshdata-fabricbicepenterprise-scale-analyticsdata-product
  Language:Bicep 74

• fabioms-br / estudados

  Banco de Dados para Estudo

  azureazure-sqlazure-sql-databasedatadata-analysisdata-miningdata-platformdata-sciencedatabaselearningmicrosoftsql-serversql-server-databaset-sql
  66

• josephmachado / online_store

  End to end data engineering project

  python3data-engineeringdata-pipelinedagsterpostgresqldatawarehousedata-processingdata-platformdata-analysis
  Language:Python 49
• Shoonya

  AI4Bharat / Shoonya

  Shoonya - Platform to Annotate and label data at scale.

  annotationdata-platformlabeling
  48

• opendatadiscovery / odd-collector

  Open-source metadata collector based on ODD Specification

  data-catalogdata-discoverydata-governancedata-observabilitydata-platformdata-profilingdatacataloglineagedata-piplineshacktoberfest
  Language:Python 42

• Azure / data-product-batch

  Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 39

• Azure / data-product-streaming

  Template to deploy a Data Product for data stream processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 36
• data-platforms-tools

  ryandawsonuk / data-platforms-tools

  Guide to data platforms and tools

  azure-synapse-analyticsdata-warehousingbigquerydatabrickssnowflakedata-platformclouderadata-meshdata-governance
  31
• PawMark

  xuwenyihust / PawMark

  PawMark is a platform for developers to build, schedule and monitor data pipelines.

  jupyter-notebookmlflowsparkgcpkubernetesdelta-lakedata-engineeringdata-platformorchestrationworkflow
  Language:JavaScript 29

• chumaky / docker-images

  Postgres database with different foreign data wrapper extensions installed. Datero data platform engine image.

  data-platformdata-virtualizationdaterofdwforeign-data-wrapperheterogeneous-sqlpostgresqlreverse-etlsql
  Language:Shell 28

• govflow / govflow

  An open, modular work order and workflow management system for local government and residents.

  government311open-governmentopen-datadata-platformcrmcitiesmunicipalities
  Language:TypeScript 25

• rpj / rpi

  RPJiOS: RPJ's RPi OS, a sensor data platform for the Raspberry Pi built with python2.7 and redis.

  raspberry-pipythonsensorsredisrpigarden-botssensordata-streamdata-pipelinedata-platformdata-processing
  Language:Python 25

• davidgasquez / filecoin-data-portal

  🧮 Open and local-first data hub for Filecoin!

  data-analysisdata-platformfilecoin
  Language:Python 22
• kaggle-look-alike

  evoluteur / kaggle-look-alike

  Kaggle Data Explorer UI look-alike built in React.

  kaggledatadata-scienceexplorerfront-endfrontendspadata-analysisdatascienceexploratory-data-analysisreactdata-engineeringdata-explorationdata-platformdata-mining
  Language:JavaScript 22

• luatnc87 / open-source-modern-data-stack

  This repo demonstrate a comprehensive modern data stack using popular open-source tools.

  airbytedbtdorissupersetdata-platformdockerdocker-composemds
  Language:Shell 18

• related-sciences / articat

  articat: data artifact catalog

  data-catalogdata-discoverydata-managementdata-platform
  Language:Python 17