Beast code in Giters

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

88100

langchain

🦜🔗 Build context-aware reasoning applications

Language:PythonMIT8831100

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

Language:PythonApache-2.02535000

gradient-checkpointing

Make huge neural nets fit in memory

Language:PythonMIT265000

faiss

A library for efficient similarity search and clustering of dense vectors.

Language:C++MIT2926100

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

Language:Jupyter Notebook1031400

GPT2-Chinese

Chinese version of GPT2 training code, using BERT tokenizer.

Language:PythonMIT740100

promptbase

All things prompt engineering

Language:PythonMIT522700

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Language:PythonMIT1098400

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Language:PythonApache-2.02190900

CTranslate2

Fast inference engine for Transformer models

Language:C++MIT300700

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Language:PythonApache-2.0727300

google-research

Google Research

Language:Jupyter NotebookApache-2.03334200

BigTranslate

BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages

Language:Python20700

self-instruct

Aligning pretrained language models with instruction data generated by themselves.

Language:PythonApache-2.0391200

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

Language:PythonApache-2.02909000

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

Language:PythonMIT16351300

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Language:PythonBSD-3-Clause2512300

llama

Inference code for Llama models

Language:PythonNOASSERTION5409300

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Language:PythonApache-2.03361500

Opus-MT

Open neural machine translation models and web services

Language:PythonMIT56800

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

Language:Python947700

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

Language:PythonGPL-3.0560600

nebuly

The user analytics platform for LLMs

Language:PythonApache-2.0836500