LiHao217

llama.cpp

LLM inference in C/C++

gpt_academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

llama

Inference code for Llama models

ColossalAI

Making large AI models cheaper, faster and more accessible

WeChatMsg

提取微信聊天记录，将其导出成HTML、Word、Excel文档永久保存，对聊天记录进行分析生成年度聊天报告，用聊天数据训练专属于个人的AI聊天助手

Flowise

Drag & drop UI to build your customized LLM flow

Mr.-Ranedeer-AI-Tutor

A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.

roop

one-click face swap

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

so-vits-svc

SoftVC VITS Singing Voice Conversion

mlc-llm

Universal LLM Deployment Engine with ML Compilation

alpaca-lora

Instruct-tune LLaMA on consumer hardware

llama2.c

Inference Llama 2 in one file of pure C

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

triton

Development repository for the Triton language and compiler

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

ShiArthur03

trl

Train transformer language models with reinforcement learning.

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

GeneFace

GeneFace: Generalized and High-Fidelity 3D Talking Face Synthesis; ICLR 2023; Official code

Olive

Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.

trt-samples-for-hackathon-cn

Simple samples for TensorRT programming

onnxruntime-inference-examples

Examples for using ONNX Runtime for machine learning inferencing.

Llama-2-Onnx

alphadev

MST-plus-plus-TensorRT

:poodle: :poodle: :poodle: TensorRT 2022复赛方案： 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化

ocolos-public

Ocolos is the first online code layout optimization system for unmodified applications written in unmanaged languages.

PerFlow

Domain-specific framework for performance analysis of parallel programs