data-orchestrator

There are 2 repositories under data-orchestrator topic.

• airflow

  apache / airflow

  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  airflowapacheapache-airflowpythonschedulerworkflowautomationdagdata-engineeringdata-integrationdata-orchestratordata-pipelinesdata-scienceeltetlmachine-learningmlopsorchestrationworkflow-engineworkflow-orchestration
  Language:Python 34461

• dagster-io / dagster

  An orchestration platform for the development, production, and observation of data assets.

  data-pipelinesdagsterworkflowdata-scienceworkflow-automationpythonschedulerdata-orchestratoretlanalyticsdata-engineeringmlopsorchestrationdata-integrationmetadata
  Language:Python 10203
• kestra

  kestra-io / kestra

  Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

  datadata-engineeringdata-integrationdata-orchestrationdata-orchestratordata-pipelinedata-qualityeltetllow-codeorchestrationpipelinereverse-etlschedulerworkflowworkflow-engine
  Language:Java 6327

• DidactHQ / didact-engine

  The REST API and execution engine for the Didact Platform.

  background-jobsdata-engineeringdata-orchestratordata-pipelinesdotnetdotnet-standardorchestratorparallel-processingpipelinesrest-apiworkflowworkflow-engine
  Language:C# 45

• DidactHQ / didact

  The open source, standalone, fullstack .NET job orchestrator that we've been missing.

  background-jobsbackground-servicedata-engineeringdata-orchestratordata-pipelinesorchestrationorchestration-frameworkorchestratorpipelinesworkflow-engineworkflows
  31

• DidactHQ / didact-ui

  The VueJS single-page app dashboard for the Didact Platform.

  data-engineeringdata-orchestratordata-pipelinesdevextremedotnetorchestratorpipelinesvuejsworkflowworkflow-engine
  Language:Vue 11
• DataPractitioner

  AnanthaRajuC / DataPractitioner

  Data Practitioner

  clickhousedagsterdatawarehousedbtmysqlolapdata-engineeringdata-orchestratordata-pipelinesworkflow-automation
  Language:Python 3

• vandenn / dagster-prio-dynamic-map

  A reference repository for implementing Dynamic Mapping and Op Prioritization with Dagster.

  dagsterdata-engineeringdata-integrationdata-orchestratordata-pipelinesdynamic-mappingetlorchestrationparallelizationpython
  Language:Python 2