shenfe

open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

meta-prompting

Official implementation of paper "Meta Prompting for AGI Systems" (https://arxiv.org/abs/2311.11482)

ArXivQA

WIP - Automated Question Answering for ArXiv Papers with Large Language Models (https://arxiv.taesiri.xyz/)

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Awesome-LLM-KG

Awesome papers about unifying LLMs and KGs

dl4math

Resources of deep learning for mathematical reasoning (DL4MATH).

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

SafeNLP

Safety Score for Pre-Trained Language Models

dspy

DSPy: The framework for programming—not prompting—foundation models

facefusion

Next generation face swapper and enhancer

OpenMoE

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

multipack_sampler

Multipack distributed sampler for fast padding-free training of LLMs

galai

Model API for GALACTICA

semantic-memorization

GAP

[ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization

olm-datasets

Pipeline for pulling and processing online language model pretraining data from the web

anything-llm

The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.

ML-Papers-of-the-Week

🔥Highlighting the top ML papers every week.

mteb

MTEB: Massive Text Embedding Benchmark

LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.

Awasome-Pruning

Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

python-searchengine

DecomP

Repository for Decomposed Prompting

AGiXT

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

knowledge-graph-from-GPT

Using GPT to organize and access information, and generate questions. Long term goal is to make an agent-like research assistant.

safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting