cmu-catalyst

collage

System for automated integration of deep learning backends.

GradSign

Code for paper GradSign: Model Performance Inference with Theoretical Insights

cmu-catalyst.github.io

FlexFlow

A distributed deep learning framework that supports flexible parallelization strategies.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs