Amanda-Barbara

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

llm.c

LLM training in simple, raw C/CUDA

jina

☁️ Build multimodal AI applications with cloud-native stack

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

py-spy

Sampling profiler for Python programs

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

yolov10

YOLOv10: Real-Time End-to-End Object Detection

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

flops-counter.pytorch

Flops counter for convolutional networks in pytorch framework

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

flashinfer

FlashInfer: Kernel Library for LLM Serving

LLaVA-NeXT

CUDA-Learn-Notes

🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

tensorrtllm_backend

The Triton TensorRT-LLM Backend

EAGLE

[ICML'24] EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

Awesome-LLM-Long-Context-Modeling

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

MiniGPT4-video

Official code for MiniGPT4-video

ring-flash-attention

Ring attention implementation with flash attention

Consistency_LLM

[ICML 2024] CLLMs: Consistency Large Language Models

long-context-attention

Sequence Parallel Attention for Long Context LLM Model Training and Inference

vllm_backend

llm_long_context_bench202405

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.