TowardSun

triton

Development repository for the Triton language and compiler

openai-python

The official Python library for the OpenAI API

llm-foundry

LLM training code for Databricks foundation models

t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

promptsource

Toolkit for creating, sharing and using natural language prompts.

awesome-public-datasets

A topic-centric list of HQ open datasets.

ChineseNlpCorpus

搜集、整理、发布 中文 自然语言处理 语料/数据集，与 有志之士 共同 促进 中文 自然语言处理 的 发展。

Dromedary

Dromedary: towards helpful, ethical and reliable LLMs.

Alpaca-CoT

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

Yuan-1.0

Yuan 1.0 Large pretrained LM

z-bench

Z-Bench 1.0 by 真格基金：一个麻瓜的大语言模型中文测试集。Z-Bench is a LLM prompt dataset for non-technical users, developed by an enthusiastic AI-focused team in Zhenfund.

BBT-FinCUGE-Applications

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

ChatPaper

Use ChatGPT to summarize the arXiv papers. 全流程加速科研，利用chatgpt进行论文全文总结+专业翻译+润色+审稿+审稿回复

Awesome-LLM-Reasoning

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

metaseq

Repo for external large-scale work

LangChain-Chinese-Getting-Started-Guide

LangChain 的中文入门教程

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

icetk

A unified tokenization tool for Images, Chinese and English.

langchain

🦜🔗 Build context-aware reasoning applications

Pix2Text

An Open-Source Python3 tool for recognizing layouts, tables, math formulas (LaTeX), and text in images, converting them into Markdown format. A free alternative to Mathpix, empowering seamless conversion of visual content into text-based representations. 80+ languages are supported.

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways