data-orchestrator

There are 8 repositories under data-orchestrator topic.

• airflow

  apache / airflow

  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  airflowapacheapache-airflowautomationdagdata-engineeringdata-integrationdata-orchestratordata-pipelinesdata-scienceeltetlmachine-learningmlopsorchestrationpythonschedulerworkflowworkflow-engineworkflow-orchestration
  Language:Python 43134

• dagster-io / dagster

  An orchestration platform for the development, production, and observation of data assets.

  analyticsdagsterdata-engineeringdata-integrationdata-orchestratordata-pipelinesdata-scienceetlhacktoberfestmetadatamlopsorchestrationpythonschedulerworkflowworkflow-automation
  Language:Python 14369

• Netflix / maestro

  Maestro: Netflix’s Workflow Orchestrator

  analyticsautomationbatch-processingdagdata-engineeringdata-opsdata-orchestratordata-pipelinesdata-scienceeltetljavamachine-learningmaestromlopsorchestrationschedulerworkflowworkflow-engineworkflow-orchestration
  Language:Java 3642

• DidactHQ / didact

  The open core .NET job orchestrator that we've been missing

  background-jobsbackground-servicedata-engineeringdata-orchestratordata-pipelinesorchestrationorchestration-frameworkorchestratorpipelinesworkflow-engineworkflows
  Language:C# 133

• DidactHQ / didact-engine

  The REST API and execution engine for the Didact Platform.

  data-engineeringdata-pipelinesdotnetdotnet-standardorchestratorparallel-processingpipelinesrest-apiworkflowworkflow-enginedata-orchestratorbackground-jobs
  Language:C# 78

• runodp / dagster-odp

  A configuration-driven framework for building Dagster pipelines that enables teams to create and manage data workflows using YAML/JSON instead of code

  data-analyticsdata-engineeringdata-integrationdata-orchestratordata-pipelineseltetlmetadataorchestrationpythonschedulerdagster
  Language:Python 37

• DidactHQ / didact-ui

  The web dashboard for the Didact Platform.

  data-engineeringdata-orchestratordata-pipelinesdevextremedotnetorchestratorpipelinesvuejsworkflowworkflow-engine
  Language:C# 22

• vandenn / dagster-prio-dynamic-map

  A reference repository for implementing Dynamic Mapping and Op Prioritization with Dagster.

  dagsterdata-engineeringdata-integrationdata-orchestratordata-pipelinesdynamic-mappingetlorchestrationparallelizationpython
  Language:Python 9

• yamtimor / BirdLane

  Kotlin DSL for expressive, code-first data pipelines, inspired by jazz.

  data-engineeringdata-orchestratorkotlin
  Language:Kotlin 6
• DataPractitioner

  AnanthaRajuC / DataPractitioner

  Data Practitioner

  clickhousedagsterdatawarehousedbtmysqlolapdata-engineeringdata-orchestratordata-pipelinesworkflow-automation
  Language:Python 5

• GADES-DATAENG / webinar

  Code, scripts, and resources for the Data Engineering Fundamentals Course Webinar, covering Python, data pipelines, Apache Airflow, and more.

  apache-airflowdata-engineeringdata-orchestrationdata-orchestratordata-pipelinesdimensional-modelingpythonsql
  Language:Python 1

• Wireforce-LLC / m3

  ☕ Data Orchestrator. Without abstractions

  airflowcloudcloud-functionsdagsdata-orchestrationdata-orchestratordata-sciencedata-structures
  Language:TypeScript 0

• apache / airflow-publish

  Publishing PyPI packages for Apache Airflow

  airflowapacheapache-airflowautomationdagdata-engineeringdata-integrationdata-orchestratordata-pipelinesdata-scienceeltetlmachine-learningmlopsorchestrationpythonschedulerworkflowworkflow-engineworkflow-orchestration
  Language:Python

• philiporlando / dagster_university

  I created this repo to follow along with the examples in the Dagster University Essentials course.

  dagsterdata-orchestrationdata-orchestratoretl
  Language:Python