garyfanhku

ChatGPT-Next-Web

A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。

lobe-chat

🤯 Lobe Chat - an open-source, modern-design LLMs/AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Bedrock / Azure / Mistral / Perplexity ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT chat application.

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM) QA app with langchain

guidance

A guidance language for controlling large language models.

ml-engineering

Machine Learning Engineering Open Book

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

resume

Software developer resume in Latex

alignment-handbook

Robust recipes to align language models with human and AI preferences

lmql

A language for constraint-guided and efficient LLM programming.

Awesome-LLMOps

An awesome & curated list of best LLMOps tools for developers

weak-to-strong

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

Awesome-LLM-Reasoning

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

LookaheadDecoding

flashinfer

FlashInfer: Kernel Library for LLM Serving

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

Awesome-Out-Of-Distribution-Detection

A professionally curated list of papers, tutorials, books, videos, articles and open-source libraries etc for Out-of-distribution detection, robustness, and generalization

gritlm

Generative Representational Instruction Tuning

adept-inference

Inference code for Persimmon-8B

honest_llama

Inference-Time Intervention: Eliciting Truthful Answers from a Language Model

DoLa

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

Awesome-Information-Bottleneck

This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.

BMPrinciples

A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or laws in the future

parameter-efficient-moe

baukit

OpenASCE

OpenASCE (Open All-Scale Casual Engine) is a Python package for end-to-end large-scale causal learning. It provides causal discovery, causal effect estimation and attribution algorithms all in one package.

FactorCL

[NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy

rag-demo

popbias