data-mesh

There are 13 repositories under data-mesh topic.

• datopian / portaljs

  🌀 Rapidly build feature-rich data portals using a modern frontend framework. Native CKAN support. OpenMetadata and Git compatible.

  data-portaldata-portalsckandata-portal-frontendsdata-presentationdata-fabricdata-management-platformnextjsopen-data-portalreactdata-meshdatahubopen-dataopenmetadatadataversedkanopendatasoftsocrata
  Language:TypeScript 2255
• open-data-contract-standard

  bitol-io / open-data-contract-standard

  Home of the Open Data Contract Standard (ODCS).

  datadata-contractdata-contractsdata-engineeringdata-meshdata-qualitystandard
  Language:Ruby 581

• paypal / data-contract-template

  Template for a data contract used in a data mesh.

  datadata-contractdata-engineeringdata-mesh
  480

• merantix-momentum / squirrel-core

  A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:

  pythonmlmachine-learningdata-sciencecomputer-visioncvnlpnatural-language-processingaipytorchtensorflowdatasetsdistributeddataopsdeep-learningdata-meshdata-ingestioncloud-computingcollaborationinternal
  Language:Python 281

• Azure / data-management-zone

  Template to deploy the Data Management Zone of Cloud Scale Analytics (former Enterprise-Scale Analytics). The Data Management Zone provides data governance and management capabilities for the data platform of an organization.

  enterprise-scalearmazurearchitecturepolicy-drivendata-platformbicepdata-meshdata-fabricenterprise-scale-analyticsdatamesh
  Language:Bicep 174

• Azure / data-landing-zone

  Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Landing Zone is a logical construct and a unit of scale in the architecture that enables data retention and execution of data workloads for generating insights and value with data.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdatamesh
  Language:Bicep 171
• opendatadiscovery-specification

  opendatadiscovery / opendatadiscovery-specification

  ODD Specification is a universal open standard for collecting metadata.

  specificationspecopen-sourcebig-databig-data-platformdata-meshapidata-engineeringdata-discoveryopensourcedata-platformmetadatametadata-managementmetadata-parserdata-governance
  144
• odm-specification-dpdescriptor

  opendatamesh-initiative / odm-specification-dpdescriptor

  The Data Product Descriptor Specification (DPDS) Repository

  data-contractdata-meshdata-productcomputational-governancedata-product-descriptordpds-specificationspecspecificationdata-fabricmetadata-management
  Language:HTML 81

• Azure / data-product-analytics

  Template to deploy a Data Product for analytics and data science use-cases into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to create insights and products for external users.

  architecturearmazurebicepdata-fabricdata-meshdata-platformdata-productenterprise-scaleenterprise-scale-analyticspolicy-driven
  Language:Bicep 80

• conduktor / conduktor-poc-kafka-protocol

  POC to demonstrate how to alter incoming/outgoing records in Kafka. It's a toy, don't use it in production.

  chaosdata-governancedata-meshkafkagateway
  Language:Java 65

• jupyter-naas / drivers

  Low-code Python library enabling access to APIs, tools, data sources in seconds.

  connectorsdatadata-analysisdata-collectiondata-engineeringdata-integrationdata-meshdata-scienceeltetlhacktoberfesthacktoberfest2022integrationlowcodeopen-sourceopensourcepipelinepipelinespython
  Language:Python 59

• merantix-momentum / squirrel-datasets-core

  Squirrel dataset hub

  aicloud-computingcollaborationcomputer-visioncvdata-ingestiondata-meshdata-sciencedataopsdatasetsdeep-learningdistributedmachine-learningmlnatural-language-processingnplpythonpytorchtensorflow
  Language:Python 42

• Azure / data-product-batch

  Template to deploy a Data Product for Batch data processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 38

• bitol-io / open-data-product-standard

  Home of the Open Data Product Standard (ODPS).

  datadata-engineeringdata-meshdata-productdata-productsdata-qualitystandard
  Language:Shell 38

• Azure / data-product-streaming

  Template to deploy a Data Product for data stream processing into a Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Product template can be used by cross-functional teams to ingest, provide and create new data assets within the platform.

  armazurearchitecturedata-platformenterprise-scalepolicy-drivenbicepdata-meshdata-fabricenterprise-scale-analyticsdata-productdata-integration
  Language:Bicep 36
• data-platforms-tools

  ryandawsonuk / data-platforms-tools

  Guide to data platforms and tools

  azure-synapse-analyticsdata-warehousingbigquerydatabrickssnowflakedata-platformclouderadata-meshdata-governance
  32
• dprod

  EKGF / dprod

  Artifacts of the EKGF Data Product Workgroup (DPROD)

  data-meshdata-productekgdprodekgfomg
  Language:HTML 30
• learning-data-mesh

  lynnlangit / learning-data-mesh

  Repo with resources for learning Data Mesh

  data-meshdatamesh
  23

• DataChefHQ / aws-data-landing-zone

  The Data Landing Zone is a CDK Construct designed to create a landing zone tailored for supporting and enabling AI, data-driven, data mesh, and cloud projects.

  aiawscdkdata-meshlanding-zone
  Language:TypeScript 22

• O2-Czech-Republic / proxima-platform

  The Proxima platform.

  batch-processinganalytical-platformunified-data-processingapache-sparkapache-flinkapache-beamiot-platformdata-meshstream-processing
  Language:Java 21

• Mehdi-H / WeeklyCuration

  Interesting links I saw, every week

  architectureartificial-intelligencecloudcurationdata-meshddddevopsmlopsnewspythonveille-technique
  Language:Makefile 20

• opendatamesh-initiative / odm-platform

  A platform to manage the data product life cycle

  data-meshdata-managementdata-productdata-contractdata-fabriccomputational-governance
  Language:HTML 20
• ansilo

  ansilo-data / ansilo

  A Postgres interface into any database

  data-engineeringdata-meshdata-productsdata-virtualizationpostgresql-extensionsql-med
  Language:Rust 16

• Iotic-Labs / iotics-identity-py

  Create Data Mesh. Use interoperable digital twins to create data interactions and build powerful real-time data products. This repository is a library for Decentralised Identity (DID) management with Iotics for applications in Python v3.8+.

  identitydidsdkpythonpython3ioticsdigital-twinsdata-interactiondata-meshidentity-apipypiidentities-managementbddiot
  Language:Python 16

• Iotic-Labs / iotics-identity-go

  Create Data Mesh. Use interoperable digital twins to create data interactions and build powerful real-time data products. This repository is a library for Decentralised Identity (DID) management with Iotics for applications in Golang.

  golangiotidentitysdkbdddididentity-apidata-interactiondata-meshdigital-twinsioticsidentities-management
  Language:Go 15

• agile-lab-dev / governance-decision-record

  The Governance Decision Record (GDR) is a specification model for (computational) data governance policies inspired from the ADR (Architectural Decision Record).

  architectural-decision-recordsdatadata-governancedata-managementdata-management-platformdata-meshplatformfederated-computational-governancegovernance-decision-recordpolicy-as-code
  Language:CUE 13

• opendatamesh-initiative / odm-specification-datastoreapi

  The Data Store API Specification Repository

  data-contractsdata-meshdata-productdata-product-descriptormetadata-managementspecspecificationdsas-specification
  Language:HTML 12

• findinpath / trino_data_mesh

  Proof of concept on how to gain insights with Trino across different databases from a distributed data mesh

  trinodbdata-meshdbt
  8

• aws-samples / data-mesh-datazone-cdk-cloudformation

  This solution provides the AWS CDK and AWS CloudFormation infrastructure to build an enterprise data mesh with Amazon DataZone.

  cdkcloudformationdata-managementdata-meshdatazone
  Language:Python 7

• Iotic-Labs / api

  Create Data Mesh. Use interoperable digital twins to create data interactions and build powerful real-time data products. This repository contains protocol buffers specification for Iotics API.

  bufdata-interactiondata-meshdigital-twinsiotioticsprotoprotobuf
  Language:Makefile 7

• Yazdi9 / Enhanced_3DHuman_Geneartion

  3D Human Generation With Mesh From 2D Images

  3d-generationdata-meshgenerative-aihuman-generationimage-to-3dmesh-generationmotion-generationavatar-generation
  Language:Jupyter Notebook 6

• limagbz / data-mesh-yelp

  A complete data product project used to study concepts related to data enginerring such as modeling, collection, operations and so on.

  data-engineeringkubernetespipelinesdata-meshgrafanagrafana-lokimicrok8sprometheusdevcontainerminioyelp-datasetchange-data-capturedebeziumkafkakafka-connect
  Language:Smarty 5

• ondat / charts

  Ondat Helm charts.

  chartsdata-meshhelmhelm-chartskubernetesondatoperatorpersistent-storage
  Language:Shell 4

• ondat / documentation

  Ondat documentation content.

  ondatpersistent-storagetechnical-documentationmarkdowndocumentationdata-mesh
  Language:Shell 4
• riffl

  riffl / riffl

  Riffl - generic streaming data ingestion framework

  bigdataexactly-onceingestkafkaorcparquets3sinkstreaming-datarifflstreamingdata-lakedata-meshbig-datastream-processing
  Language:Java 4

• findinpath / dbt_jaffle_shop_data_mesh

  A self-contained dbt project for showcasing the capabilities of the dbt-trino adapter

  dbtdbt-trinodata-mesh
  Language:Dockerfile 3