There are 21 repositories under pipelines topic.
Airbyte is an open-source EL(T) platform that helps you replicate your data in your warehouses, lakes and databases.
Concourse is a container-based continuous thing-doer written in Go.
Build data pipelines, the easy way 🛠️
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Event-driven workflow automation framework
A Julia machine learning framework
Elyra extends JupyterLab with an AI centric approach.
A lightweight stream processing library for Go
Framework for large distributed pipelines
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
🦊 Test your Gitlab CI Pipelines changes locally using Docker.
Livekeys - Automation Platform with support for live scripting.
Azure DevOps Extension for Azure CLI
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
A web-based monitor dashboard for GitLab CI
Platform for Situated Intelligence
An experimental programming language for data flow
Command Line Tools for Drone CI
Extensible data integration Java framework for building XML and non-XML fragment-based applications
A framework for pluggable business logic components
Your open source DataOps Platform Infrastructure to let you manage all the data tools in your stack in one place, and turn them into your ideal end-to-end data platform
mkdkr = Makefile + Docker
Azure AKS Kubernetes Masterclass
A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.
Train and run Pytorch models on Apache Spark.
Use SQL to build ELT pipelines on a data lakehouse.
Fast, flexible, and version-tolerant serializer for .NET
Use C# instead of YAML to define your Azure DevOps pipelines
High performance data aggregating storage