davidwong18

ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, Axolotl, etc.

wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit

calm

CUDA/Metal accelerated language model inference

marktext

📝A simple and elegant markdown editor, available for Linux, macOS and Windows.

Captura

Capture Screen, Audio, Cursor, Mouse Clicks and Keystrokes

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。

Awosome-LLM

Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

awesome-LLMs-In-China

**大模型

Awesome-Domain-LLM

收集和梳理垂直领域的开源模型、数据集及评测基准。

Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Awesome-Efficient-LLM

A curated list for Efficient Large Language Models

Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

awesome-generative-ai

A curated list of modern Generative Artificial Intelligence projects and services

Awesome-LLM-Survey

An Awesome Collection for LLM Survey

LocalAIVoiceChat

Local AI talk with a custom voice based on Zephyr 7B model. Uses RealtimeSTT with faster_whisper for transcription and RealtimeTTS with Coqui XTTS for synthesis.

awesome-local-llms

Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.

Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

Awesome-LLM-Tabular

Awesome-LLM-Tabular: a curated list of Large Language Model applied to Tabular Data

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

X-AnyLabeling

Effortless data labeling with AI support from Segment Anything and other awesome models.

markdown-it

Markdown parser, done right. 100% CommonMark support, extensions, syntax plugins & high speed

SheetCopilot

We release a general framework for prompting LLMs to manipulate software in a closed-loop manner.

large-qa-datasets

A collection of large question answering datasets

UglifyJS

JavaScript parser / mangler / compressor / beautifier toolkit

jsoneditor

A web-based tool to view, edit, format, and validate JSON

auto-cot

Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)