Dan Rammer's repositories
omniscient
A collection of scripts for distributed resource monitoring.
scripts
Collection of general use scripts.
bitswap-cannon
Benchmarking utility for the bitswap protocol in IPFS
datacatalog
Data Catalog is a service for indexing parameterized, strongly-typed data artifacts across revisions. It also powers Flytes memoization system
flyte
Kubernetes-native workflow automation platform for complex, mission-critical data and ML processes at scale. It has been battle-tested at Lyft, Spotify, Freenome, and others and is truly open-source.
flyteadmin
Control Plane for Flyte. Flyteadmin is a gRPC + REST Service written in golang and uses a RDBMs to store meta information and management information for Flyte Tasks and Workflows.
flyteidl
Flyte at its core has a declarative, type-safe language for declaring data dependencies between arbitrary computation units. This repository contains the core specification of this language in the form of protocol-buffers.
flytekit
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
flyteplugins
Flyte Backend Plugins contributed by the Flyte community.
flytepropeller
FlytePropeller is a Kubernetes native operator, that executes Flyte Workflows and Tasks. It has its own kubectl-flyte CLI to interact and is extensible using the flyteplugins/pluginmachinery interface
flytesnacks
Flyte Examples, User-Guides and Tutorials - https://flytecookbook.readthedocs.io/en/latest/
flytestdlib
A apache commons style library in Golang, use by the Flyte project. Contains utilities for metrics, pflags, config management, storage abstraction, caching etc
go-ipfs-docker
IPFS cluster deployment using docker-compose
kubernetes
Production-Grade Container Scheduling and Management
NahSpark
Spark SQL datasource for the NahFS framework
ncproj
reproject gridded netCDF data using shapefiles
ncproj-rs
reproject netcdf data using shapefiles
scm
extensible utility to extract static code metrics