luoyujiaye

Megatron-LM

Ongoing research training transformer models at scale

Megatron-LLaMA

Best practice for training LLaMA models in Megatron-LM

langchain

🦜🔗 Build context-aware reasoning applications

llm-cookbook

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

OpenLLMWiki

OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXiu-貔貅 means fortune.

Awesome-Text2SQL

Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.

OrionStar-Yi-34B-Chat

OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型，由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。

Cherry_LLM

[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models

science-llm

A large-scale language model for scientific domain, trained on redpajama arXiv split

AlignmentSurvey

AI Alignment: A Comprehensive Survey

franxyao.github.io

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

yuren-baichuan-7b

基于baichuan-7b的开源多模态大语言模型

pandallm

Panda项目是于2023年5月启动的开源海外中文大语言模型项目，致力于大模型时代探索整个技术栈，旨在推动中文自然语言处理领域的创新和合作。

landmark-attention

Landmark Attention: Random-Access Infinite Context Length for Transformers

awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。

tensorflow

An Open Source Machine Learning Framework for Everyone

reward-modeling

Chinese-LangChain

中文langchain项目|小必应，Q.Talk，强聊，QiangTalk

LLMPruner

ChatRWKV

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

Prompt-Engineering-Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

LM-BFF

[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

promptsource

Toolkit for creating, sharing and using natural language prompts.

awesome-chatgpt-prompts

This repo includes ChatGPT prompt curation to use ChatGPT better.