HPC-AI Tech

ColossalAI

Making large AI models cheaper, faster and more accessible

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

EnergonAI

Large-scale model inference.

FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters

SwiftInfer

Efficient AI Inference & Serving

ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI

PaLM-colossalai

Scalable PaLM implementation of PyTorch

CachedEmbedding

A memory efficient DLRM training solution using ColossalAI

SkyComputing

Sky Computing: Accelerating Geo-distributed Computing in Federated Learning

TensorNVMe

A Python library transfers PyTorch tensors between CPU and NVMe

ColossalAI-Benchmark

Performance benchmarking with ColossalAI

Titans

A collection of models built with ColossalAI

ColossalAI-Documentation

Documentation for Colossal-AI

ColossalAI-Pytorch-lightning

Oh-My-Dockerfile

A collection of dockerfiles for various tasks

Elixir

Elixir: Train a Large Language Model on a Small GPU Cluster

GPT-Demo

GPT Demo with hybrid distributed training

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

ColossalAI-Platform-CLI

CLI for ColossalAI Platform

public_assets

Storing publicly available assets such as images, animations and texts

OPT-Benchmark

mmdetection-examples

Train mmdetection models with ColossalAI.

CANN-Installer

This repository contains Huawei Ascend CANN files

Cloud-Platform-Docs

Documentation for our cloud platform

pytest-testmon

Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.

torchrec

Pytorch domain library for recommendation systems