Dan Rammer's repositories
scripts
Collection of general use scripts.
omniscient
A collection of scripts for distributed resource monitoring.
flyte
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
flytekit
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
flytepropeller
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
datacatalog
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
flyteplugins
Flyte Backend Plugins contributed by the Flyte community.
flyteidl
Flyte at its core has a declarative, type-safe language for declaring data dependencies between arbitrary computation units. This repository contains the core specification of this language in the form of protocol-buffers.
kubernetes
Production-Grade Container Scheduling and Management
flytestdlib
A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc
flytesnacks
Flyte Examples, User-Guides and Tutorials - https://flytecookbook.readthedocs.io/en/latest/
flytectl
A cross platform CLI for Flyte. Written in Golang. Offers an intuitive interface to Flyte https://flytectl.readthedocs.io/en/latest/
flyteadmin
Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.
scm
extensible utility to extract static code metrics
NahSpark
Spark SQL datasource for the NahFS framework
bitswap-cannon
Benchmarking utility for the bitswap protocol in IPFS
go-ipfs-docker
IPFS cluster deployment using docker-compose
ncproj
reproject gridded netCDF data using shapefiles
ncproj-rs
reproject netcdf data using shapefiles