hkvision

langchain

🦜🔗 Build context-aware reasoning applications

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

pytorch_geometric

Graph Neural Network Library for PyTorch

alpaca-lora

Instruct-tune LLaMA on consumer hardware

dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.

dalai

The simplest way to run LLaMA on your local machine

MOSS

An open-source tool-augmented conversational language model from Fudan University

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

ggml

Tensor library for machine learning

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

SuperCLUE

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

exllama

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

gptq

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

langchain-serve

⚡ Langchain apps in production using Jina & FastAPI

ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

P-tuning

A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.

Multitask-Recommendation-Library

MTReclib provides a PyTorch implementation of multi-task recommendation models and common datasets.

FastEval

Fast & more realistic evaluation of chat language models. Includes leaderboard.

bigdl-llm-tutorial

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

Gaudi2-Workshop

BigDL-Distributed-Training-and-Inference-Workflow

BigDL-Recommender-System-Toolkit