Ma-Dan's repositories

llama.cpp

Port of Facebook's LLaMA model in C/C++

Language:C++License:MITStargazers:2Issues:0Issues:0

llama2.c-to-ncnn

A converter for llama2.c legacy models to ncnn models.

Language:PythonLicense:MITStargazers:2Issues:0Issues:0

ChatLM-mini-Chinese

中文对话0.2B小模型(ChatLM-Chinese-0.2B),开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调。

Language:PythonLicense:Apache-2.0Stargazers:1Issues:0Issues:0

CUDA-Learn-Note

🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记,个人笔记,更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

License:GPL-3.0Stargazers:1Issues:0Issues:0
Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

ChatGLM-MNN

Pure C++, Easy Deploy ChatGLM-6B.

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

ColossalAI

Making large AI models cheaper, faster and more accessible

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

DAIL-SQL

A efficient and effective few-shot NL2SQL method on GPT-4.

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

DB-GPT

Revolutionizing Database Interactions with Private LLM Technology

Language:PythonLicense:MITStargazers:0Issues:0Issues:0

FastChat

The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

fastllm

纯c++的全平台llm加速库,支持python调用,chatglm-6B级模型单卡可达10000+token / s,支持glm, llama, moss基座,手机端流畅运行

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

Fooocus

Focus on prompting and generating

Language:PythonLicense:GPL-3.0Stargazers:0Issues:0Issues:0
Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

InferLLM

a lightweight LLM model inference framework

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

k2

FSA/FST algorithms, differentiable, with PyTorch compatibility.

Language:CudaLicense:Apache-2.0Stargazers:0Issues:0Issues:0

llama2.c

Inference Llama 2 in one file of pure C

Language:CLicense:MITStargazers:0Issues:0Issues:0
Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Language:C++License:NOASSERTIONStargazers:0Issues:0Issues:0

Open-Sora-Plan

This project aim to reproducing Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

License:NOASSERTIONStargazers:0Issues:0Issues:0

PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Language:CLicense:MITStargazers:0Issues:0Issues:0

PythonRobotics

Python sample codes for robotics algorithms.

Language:PythonLicense:NOASSERTIONStargazers:0Issues:0Issues:0

QAnything

Question and Answer based on Anything.

License:Apache-2.0Stargazers:0Issues:0Issues:0

RTK

Reconstruction Toolkit

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

sherpa

Speech-to-text server framework with next-gen Kaldi

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

sherpa-ncnn

Real-time speech recognition using next-gen Kaldi with ncnn

Language:C++License:Apache-2.0Stargazers:0Issues:0Issues:0

TNN

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and per

Language:C++License:NOASSERTIONStargazers:0Issues:0Issues:0

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

WeTextProcessing

Text Normalization & Inverse Text Normalization

Language:PythonLicense:Apache-2.0Stargazers:0Issues:0Issues:0

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

Language:PythonLicense:MITStargazers:0Issues:0Issues:0