Beast code in Giters

Misby's starred repositories

llm_kvcache_sparsity

Implement some method of LLM KV Cache Sparsity

Language:Python1200

agi

Android GPU Inspector

Language:GoApache-2.092600

MiniCPM-V

MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone

Language:PythonApache-2.0799900

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

Language:PythonGPL-3.06224600

llamafile

Distribute and run LLMs with a single file.

Language:C++NOASSERTION1714700

aimet

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Language:PythonNOASSERTION202300

MCSD

Multi-Candidate Speculative Decoding

Language:PythonMIT2100

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD-3-Clause100

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Language:PythonBSD-3-Clause537400

FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

Language:TypeScriptNOASSERTION1561000