dinglinhui

vscode

Visual Studio Code

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

netron

Visualizer for neural network, deep learning and machine learning models

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

sealos

Sealos is a production-ready Kubernetes distribution that provides a one-stop solution for both public and private cloud. https://sealos.io

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/

mamba

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

openplayground

An LLM playground you can run on your laptop

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

w64devkit

Portable C and C++ Development Kit for x64 (and x86) Windows

AutoChain

AutoChain: Build lightweight, extensible, and testable LLM Agents

LLM-Finetuning

LLM Finetuning with peft

EasyEdit

An Easy-to-use Knowledge Editing Framework for LLMs.

langchain-tutorials

A set of LangChain Tutorials from my youtube channel

machine-learning-notes

Collection of useful machine learning codes and snippets (originally intended for my personal use)

llm-tutorials

A set of LLM Tutorials from my youtube channel

pytorch-transformer

Attention is all you need implementation

pykoi

pykoi: Active learning in one unified interface

tabbyAPI

An OAI compatible exllamav2 API that's both lightweight and fast

koboldcpp-rocm

AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading

LLM-finetuning-scripts

ChatGLM-LoRA-RLHF-PyTorch

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

Interactive-RAG

Using MongoDB Atlas + ActionWeaver, we can build a user proxy agent that efficiently retrieves and ingests relevant information. This agent presents the data to the user in an interactive and customizable manner, enhancing the overall user experience.

langchain-streamlit-demo

langchain-streamlit demo with streaming llm, memory, and langsmith feedback

label-studio-examples

Example Code to Supplement the Label Studio Blog