星纬's repositories
apex
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
awesome-adaptive-computation
A curated reading list of research in Adaptive Computation (AC) & Mixture of Experts (MoE).
awesome-AI-system
paper and its code for AI System
awesome-decentralized-llm
Collection of LLM resources that can be used to build products you can "own" or to perform reproducible research.
Awesome-Domain-LLM
收集和梳理垂直领域的开源模型、数据集及评测基准。
Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
awesome-mixture-of-experts
A collection of AWESOME things about mixture-of-experts
Awesome-Mixture-of-Experts-Papers
A curated reading list of research in Mixture-of-Experts(MoE).
Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.
Awesome-state-space-models
Collection of papers on state-space models
Chinese-LLaMA-Alpaca
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Efficient-LLMs-Survey
Efficient Large Language Models: A Survey
glake
GLake: optimizing GPU memory management and IO transmission.
inferflow
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
llama-moe
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
llama2.c
Inference Llama 2 in one file of pure C
llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
MiniGemini
Official implementation for Mini-Gemini
mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
nccl-rdma-sharp-plugins
RDMA and SHARP plugins for nccl library
Open-Sora
Open-Sora: Democratizing Efficient Video Production for All
radishes
Cross-platform copyright-free music platform(跨平台的无版权音乐平台). 支持 windows / macos / linux / web
survey_HA_LLM
A survey on Hardware Accelerated LLMs
Yi
A series of large language models trained from scratch by developers @01-ai