Kermit Griffeth's starred repositories

llama.cpp

LLM inference in C/C++

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

Language:PythonLicense:Apache-2.0Stargazers:39989Issues:393Issues:1290

chatgpt-web

用 Express 和 Vue3 搭建的 ChatGPT 演示网页

Langchain-Chatchat

Langchain-Chatchat(原Langchain-ChatGLM, Qwen 与 Llama 等)基于 Langchain 与 ChatGLM 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

Language:TypeScriptLicense:Apache-2.0Stargazers:29760Issues:276Issues:3517

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Language:PythonLicense:Apache-2.0Stargazers:17904Issues:185Issues:729

mlc-llm

Universal LLM Deployment Engine with ML Compilation

Language:PythonLicense:Apache-2.0Stargazers:17757Issues:167Issues:1174

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

Language:JavaScriptLicense:MITStargazers:17220Issues:140Issues:1203

carrot

Free ChatGPT Site List 这儿为你准备了众多免费好用的ChatGPT镜像站点

FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

Language:TypeScriptLicense:NOASSERTIONStargazers:15418Issues:103Issues:1423

Baichuan-7B

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

Language:PythonLicense:Apache-2.0Stargazers:5661Issues:66Issues:127

lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

Language:C++License:NOASSERTIONStargazers:3135Issues:59Issues:286

FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Language:C++License:Apache-2.0Stargazers:2821Issues:56Issues:1138

RtspServer

RTSP Server , RTSP Pusher

Language:C++License:MITStargazers:948Issues:45Issues:78

InferLLM

a lightweight LLM model inference framework

Language:C++License:Apache-2.0Stargazers:658Issues:10Issues:54

RtspServer

RTSP服务器,支持传输H.264和AAC格式的音视频

nndeploy

nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为内核,致力为用户提供跨平台、简单易用、高性能的模型部署体验。

Language:C++License:Apache-2.0Stargazers:459Issues:17Issues:10

gstreamer-example

Gstreamer开发教程。

Language:C++License:MITStargazers:188Issues:6Issues:3

README

A pupil in the computer world.(Felix Fu)

Language:Jupyter NotebookStargazers:153Issues:3Issues:1

gstreamer-opencv

opencv + gstreamer simple demo

cpp_streamer

cpp streamer work in dynamic modules for media develop. It include flv/mpegts/rtmp/webrtc modules, and go on developing more modules

GroundingDINO-onnxrun

使用onnxruntime部署GroundingDINO开放世界目标检测,包含C++和Python两个版本的程序

pytorch-onnx-tvm

PyTorch -> ONNX -> TVM for autotuning

Language:PythonLicense:MITStargazers:24Issues:2Issues:0

TVM_Deploy

TVM 部署及对比多个框架性能,测试加速能力

Language:C++Stargazers:9Issues:5Issues:0

tvm_cpp_time_evaluator

This project is written in pure C++. The input is a TVM compiled runtime module, and the output will be the evaluated inference time.

Language:C++License:Apache-2.0Stargazers:6Issues:1Issues:0

tvm_tensorrt

Comparing the inference performance of TVM kernel tuning, Ansor and TensorRT on ResNet

Language:C++License:MITStargazers:6Issues:1Issues:0

BlogDoc

My blog article backup

Language:CLicense:NOASSERTIONStargazers:2Issues:1Issues:0

deepstream-6.1

resource comes from deepstream-6.1_6.1.0-1_amd64.deb

Language:C++License:NOASSERTIONStargazers:1Issues:1Issues:0