ByronHsu

Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.

Language:GoApache-2.01 10

flyteadmin

Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.

Language:GoApache-2.01 10

flytekit

Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.

Language:PythonApache-2.01 10

flyteplugins

Flyte Backend Plugins contributed by the Flyte community.

Language:GoApache-2.01 10

kuberay

A toolkit to run Ray applications on Kubernetes

Language:GoApache-2.01 10

spark

Apache Spark - A unified analytics engine for large-scale data processing

Language:ScalaApache-2.01 20

submarine-dev

Share some helpful development-only files.

1 30

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Language:PythonApache-2.0010

flyteidl

Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl/en/stable/

Language:GoApache-2.0010

FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface

Apache-2.0000