orchestration

There are 53 repositories under orchestration topic.

airflow
apache / airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airflow apache apache-airflow python scheduler workflow automation dag data-engineering data-integration data-orchestrator data-pipelines data-science elt etl machine-learning mlops orchestration workflow-engine workflow-orchestration
Language:Python 34694
docker / compose
Define and run multi-container applications with Docker
docker docker-compose go golang orchestration
Language:Go 32521
dify
langgenius / dify
Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
agent ai backend-as-a-service chatbot genai gpt gpt-4 langchain llama2 llm nextjs openai orchestration python rag workflow
Language:TypeScript 29384
xstate
statelyai / xstate
Actor-based state management & orchestration for complex app logic.
state-machine statechart interpreter visualizer scxml state state-management workflow orchestration hacktoberfest finite-state-machine fsm javascript statecharts typescript background-jobs
Language:TypeScript 26228
rancher / rancher
Complete container management platform
rancher docker kubernetes orchestration cattle containers
Language:Go 22591
jina
jina-ai / jina
☁️ Build multimodal AI applications with cloud-native stack
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline fastapi generative-ai docker jaeger llmops opentelemetry cncf microservice orchestration prometheus
Language:Python 20148
PrefectHQ / prefect
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation orchestration data observability pipeline
Language:Python 14805
apache / dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
workflow-schedule azkaban airflow task-scheduler job-scheduler cloud-native data-pipelines orchestration workflow workflow-orchestration powerful-data-pipelines
Language:Java 12189
docker / labs
This is a collection of tutorials for learning how to use Docker with various tools. Contributions welcome.
docker-tutorial lab swarm docker docker-compose swarm-mode orchestration windows dotnet java security containers
Language:PHP 11468
hyperswitch
juspay / hyperswitch
An open source payments switch written in Rust to make payments fast, reliable and affordable
payments rust orchestration hacktoberfest beginner-friendly featured high-performance open-source restful-api sdk works-with-react postgresql redis finance
Language:Rust 10488
dagster-io / dagster
An orchestration platform for the development, production, and observation of data assets.
data-pipelines dagster workflow data-science workflow-automation python scheduler data-orchestrator etl analytics data-engineering mlops orchestration data-integration metadata
Language:Python 10367
Avaiga / taipy
Turns Data and AI algorithms into production-ready web applications in no time.
automation data-engineering data-integration data-ops data-visualization datascience developer-tools hacktoberfest hacktoberfest2023 job-scheduler mlops orchestration pipeline pipelines python scenario scenario-analysis taipy-core taipy-gui workflow
Language:Python 8823
infiniflow / ragflow
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
data-pipelines deep-learning document-parser document-understanding information-retrieval llm llmops machine-learning nlp ocr orchestration pdf-to-text preprocessing rag retrieval-augmented-generation table-structure-recognition
Language:Python 7526
trigger.dev
triggerdotdev / trigger.dev
Trigger.dev is the open source background jobs platform for TypeScript.
automation events orchestration scheduler background-jobs integrations nextjs serverless hacktoberfest
Language:TypeScript 7341
mage-ai / mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
artificial-intelligence data data-engineering data-integration data-pipelines data-science dbt elt etl machine-learning orchestration pipeline pipelines python reverse-etl spark sql transformation
Language:Python 7145
kestra
kestra-io / kestra
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
workflow workflow-engine orchestration scheduler data-pipeline elt etl data data-engineering data-orchestration data-orchestrator low-code data-integration reverse-etl data-quality pipeline
Language:Java 6601
rundeck / rundeck
Enable Self-Service Operations: Give specific users access to your existing tools, services, and scripts
rundeck devops deployment scheduler automation orchestration ansible audit sre operations ops devops-tools devops-team runbook hacktoberfest java
Language:Groovy 5346
infobyte / faraday
Open Source Vulnerability Management Platform
devops penetration-testing vulnerability vulnerability-scanners security security-audit pentesting continuous-scanning infosec vulnerability-management collaboration burpsuite nessus nmap devsecops security-automation orchestration cve appsec cybersecurity
Language:Python 4638
cake-build / cake
:cake: Cake (C# Make) is a cross platform build automation system.
build-automation build-automation-tool build-tool c-sharp cake cake-build continuous-integration dotnet dotnetcore hacktoberfest nuget nunit orchestration unit-testing xunit
Language:C# 3827
TheHive
TheHive-Project / TheHive
TheHive: a Scalable, Open Source and Free Security Incident Response Platform
misp security-incidents analyzer iocs thehive digital-forensics incident-response rest api scala investigations dfir free open-source platform cortex agplv3 orchestration incident-management incident-response-tooling
Language:Scala 3233
microsoft / service-fabric
Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
cloud-native containers orchestration distributed-systems cloud-computing microservices
Language:C++ 3006
nuke
nuke-build / nuke
🏗 The AKEless Build System for C#/.NET
build-automation continuous-integration nuke orchestration
Language:C# 2586
koding / koding
The Simplest Way to Manage Your Entire Dev Infrastructure!
cloud ide development orchestration development-environment development-workflow
Language:Go 2114
spotify / helios
Docker container orchestration platform
helios java docker container orchestration
Language:Java 2105
ballerine
ballerine-io / ballerine
Open-source infrastructure and data orchestration platform for risk decisioning
back-office case-management compliance dashboard flow fraud id-card-camera identity-verification idv know-your-customer kyc liveliness ocr onboarding orchestration risk-management rule-engine sdk svelte kyb
Language:TypeScript 1954
keptn
keptn / keptn
Cloud-native application life-cycle orchestration. Keptn automates your SLO-driven multi-stage delivery and operations & remediation of your applications.
kubernetes control-plane continuous-delivery operations event-based data-driven orchestration keptn cncf hacktoberfest
Language:Go 1800
apache / cloudstack
Apache CloudStack is an opensource Infrastructure as a Service (IaaS) cloud computing platform
python java cloudstack cloud iaas infrastructure kvm vsphere xenserver xcp-ng kubernetes libvirt virtual-machine virtualization vmware orchestration
Language:Java 1770
kapitan
kapicorp / kapitan
Generic templated configuration management for Kubernetes, Terraform and other things
kubernetes jsonnet kapitan orchestration docker declarative jinja2 devops devops-tools terraform jinja2-templates reclass aws-kms python gpg gitops gcp-kms python3 yaml helm
Language:Python 1748
Netflix / genie
Distributed Big Data Orchestration Service
big-data bigdata orchestration configuration configuration-management java spring-boot distributed-systems netflixoss cloud netflix-oss microservice microservices
Language:Java 1685
lastbackend
lastbackend / lastbackend
System for containerized apps management. From build to scaling.
cloud docker hosting continuous-delivery continuous-integration backend go golang containers lastbackend paas kubernetes service-discovery devops orchestration devtools pipeline container ci cd
Language:Go 1643
headlamp
headlamp-k8s / headlamp
A Kubernetes web UI that is fully-featured, user-friendly and extensible
kinvolk kubernetes headlamp plugins dashboard kubernetes-ui cloud-native debugging k8s kubernetes-dashboard kubernetes-monitoring orchestration kubernetes-debugging devops
Language:TypeScript 1642
DAGWorks-Inc / hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
data-science python dag data-engineering dataframe etl etl-framework etl-pipeline feature-engineering featurization machine-learning numpy pandas software-engineering data-analysis lineage llmops mlops orchestration hacktoberfest
Language:Jupyter Notebook 1384
pluralsh / plural
Deploy open source software on Kubernetes in record time. 🚀
kubernetes k8s multicloud cloud deployment-automation devops helm gitops graphql elixir-lang docker elixir cloud-native orchestration
Language:TypeScript 1313
clusternet / clusternet
[CNCF Sandbox Project] Managing your Kubernetes clusters (including public, private, edge, etc.) as easily as visiting the Internet
cluster-management distributed-cloud public-cloud hybrid-cloud edge-cloud cloud-native kubernetes multicloud orchestration out-of-the-box multi-cluster-management
Language:Go 1307
Shuffle
Shuffle / Shuffle
Shuffle: A general purpose security automation platform. Our focus is on collaboration and resource sharing.
automation cybersecurity openapi shuffle security workflow-editor integrations mitre-attack agplv3 discord soar hacktoberfest security-orchestrator orchestration security-automation orchestrator orchestrator-gui
Language:Shell 1275
ThousandBirdsInc / chidori
A reactive runtime for building durable AI agents
agents ai debugging framework llmops llms orchestration
Language:Rust 1199