Ruilin Zhao's starred repositories
Point-BERT
[CVPR 2022] Pre-Training 3D Point Cloud Transformers with Masked Point Modeling
NeMo-Aligner
Scalable toolkit for efficient model alignment
meshgpt-pytorch
Implementation of MeshGPT, SOTA Mesh generation using Attention, in Pytorch
ray_vllm_inference
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
the-algorithm
Source code for Twitter's Recommendation Algorithm
gpt_academic
为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。
chatgpt_system_prompt
A collection of GPT system prompts and various prompt injection/leaking knowledge.
stable-diffusion-videos
Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
FindTheChatGPTer
ChatGPT爆火，开启了通往AGI的关键一步，本项目旨在汇总那些ChatGPT的开源平替们，包括文本大模型、多模态大模型等，为大家提供一些便利
Chinese-LLaVA
支持中英文双语视觉-文本对话的开源可商用多模态模型。
pyvideotrans
Translate the video from one language to another and add dubbing. 将视频从一种语言翻译为另一种语言，并添加配音
Video-LLaVA
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
CTranslate2
Fast inference engine for Transformer models
aidea-server
AIdea 是一款支持 GPT 以及国产大语言模型通义千问、文心一言等，支持 Stable Diffusion 文生图、图生图、 SDXL1.0、超分辨率、图片上色的全能型 APP。
NeMo-Megatron-Launcher
NeMo Megatron launcher and tools
NeMo-Framework-Launcher
NeMo Megatron launcher and tools
neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
GAOKAO-Bench
GAOKAO-Bench is an evaluation framework that utilizes GAOKAO questions as a dataset to evaluate large language models.
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.