valiantljk

h5spark

Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark

allennlp

An open-source NLP research library, built on PyTorch.

alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud

code-prettify

An embeddable script that makes source-code snippets in HTML prettier.

cuda-training-series

Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)

cvat

Powerful and efficient Computer Vision Annotation Tool (CVAT)

docker-nginx

Official NGINX Dockerfiles

fluid

Fluid, elastic data abstraction layer for BigData/AI applications in cloud native systems

icml20-smp

[ICML 2020] PyTorch Code for "One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control"

kafka-python

Python client for Apache Kafka

katib

Repository for hyperparameter tuning

kubernetes

Production-Grade Container Scheduling and Management

ncem_io

explore ncem io on nersc

oap-raydp

RayDP: Distributed data processing library on Ray by running popular big data frameworks like Apache Spark on Ray. RayDP seamlessly integrates with other Ray libraries to make it simple to build E2E data analytics and AI pipeline.

pipelines

Machine Learning Pipelines for Kubeflow

py4j

Py4J enables Python programs to dynamically access arbitrary Java objects

pyprob

A PyTorch-based library for probabilistic programming and inference compilation

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

ray_beam_runner

Ray-based Apache Beam runner

redis-logger

simple logger based on redis, used in gRPC service on K8S

rust_fun

Rust program for fun

service_logger

Simple Logger for K8S services based on Redis

storage_ppl

Probabilistic Programming for Storage and I/O

tf-operator

Tools for ML/Tensorflow on Kubernetes.

tinyml

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

deltacat

A Pythonic Data Catalog powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to your big data workloads.

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

langchain-ray

Examples on how to use LangChain and Ray

petals

🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading