MissiontoMars

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

RecAI

Bridging LLM and Recommender System.

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

pytorch-deep-learning

Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

datatunerx

Large language model fine-tuning capabilities based on cloud native and distributed computing.

byzer-agent

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

generative-ai-for-beginners

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

fury

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

Ray-Forward

Some resources about Ray Forward Meetup

GLM-130B

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

thriftpy2

Pure python approach of Apache Thrift.

ColossalAI

Making large AI models cheaper, faster and more accessible

rayfed

A multiple parties joint, distributed execution engine based on Ray, to help build your own federated learning frameworks in minutes.

cloudsort

Exoshuffle-CloudSort

EnergonAI

Large-scale model inference.

ray-sql

Distributed SQL Query Engine in Python using Ray

tmux-config

Tmux configuration, that supercharges your tmux to build cozy and cool terminal environment

libai

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

mobius

Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.

flashlight

A C++ standalone library for machine learning

NVFlare

NVIDIA Federated Learning Application Runtime Environment

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

CloudShuffleService

Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.

GraphScope

🔨 🍇 💻 🚀 GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统