drunkcoding

drunkcoding.github.io

everything on distributed file system and cloud storage

huggingface-utils

model-inference

utilities and tests for model inference

alpa

Training and serving large-scale neural networks with auto parallelization.

Awesome-Places-for-Food-Drinks

cheetah-fastclick

FastClick with the Cheetah elements

complex-network-research

core

The core library and APIs implementing the Triton Inference Server.

CS411-Database-System

Project for database system -- an interactive website

DeeperSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

DLRM

efficient-nlp

eudyptula

linux kernel challenge

falcon

FALCON - Fast Analysis of LTE Control channels

flaxformer

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

jiant

jiant is an nlp toolkit

MIT-6.824-Distributed-System

Spring 2020

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

model-finetune

finetune pre-trained models

onnxruntime_backend

The Triton backend for the ONNX Runtime.

open-moe-llm-leaderboard

power-meter

A software power measurement tool for both CPU and GPU using vendor provided API

pytorch_backend

The Triton backend for the PyTorch TorchScript models.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

simple-shell

Simple functioning shell implemented in C

swap-engine

time-series-forecast

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

wasmint

Library for interpreting / debugging wasm code