GaoQ1

llama.cpp

LLM inference in C/C++

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

LeetcodeTop

汇总各大互联网公司容易考察的高频leetcode题🔥

DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

llama-cpp-python

Python bindings for llama.cpp

rags

Build ChatGPT over your data, all with natural language

ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

agents

An Open-source Framework for Autonomous Language Agents

OpenAgents

OpenAgents: An Open Platform for Language Agents in the Wild

llama-hub

A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins

zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)

trulens

Evaluation and Tracking for LLM Experiments

instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

lagent

A lightweight framework for building LLM-based agents

text_analysis_tools

中文文本分析工具包（包括- 文本分类 - 文本聚类 - 文本相似性 - 关键词抽取 - 关键短语抽取 - 情感分析 - 文本纠错 - 文本摘要 - 主题关键词-同义词、近义词-事件三元组抽取）

leetcode

python 数据结构与算法 leetcode 算法题与书籍 刷算法全靠套路与总结！Crack LeetCode, not only how, but also why.

gpt_paper_assistant

GPT4 based personalized ArXiv paper assistant bot

Polaris

ierc-miner-js

ierc-miner-tools

LlamaIndex-RAG-WSL-CUDA

Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B

UTR-LM

ord-launcher

The Ordinals Launcher is the first permissionless launcher for ordinals collections, leveraging inscriptions to allow collection creators and minters to mint ordinals with ease.