Charles's repositories
tpcds-flyte
TPC-DS for flyte workflow
flyte
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
spark
Apache Spark - A unified analytics engine for large-scale data processing
kubernetes
Production-Grade Container Scheduling and Management
flytesnacks
Flyte User-Guides and Tutorials - https://flytecookbook.readthedocs.io
datacatalog
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
submarine
Submarine is Cloud Native Machine Learning Platform.
flyteadmin
Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.
flytepropeller
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
flyteplugins
Flyte Backend Plugins contributed by the Flyte community.
flyteidl
Specification of the IR for Flyte workflows and tasks. Also Interfaces for all backend services. https://docs.flyte.org/projects/flyteidl/en/stable/
flytestdlib
A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc
pipelines
Machine Learning Pipelines for Kubeflow
tpcds-hdinsight
TPCDS benchmark for various engines