hmzo

gpt4free

The official gpt4free repository | various collection of powerful language models

ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

GPTs

leaked prompts of GPTs

unsloth

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

mamba

Mamba SSM architecture

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

chatgpt_system_prompt

A collection of GPT system prompts and various prompt injection/leaking knowledge.

MiniCPM

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

mergekit

Tools for merging pretrained large language models.

alignment-handbook

Robust recipes to align language models with human and AI preferences

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

hyperlearn

2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

simple-evals

megablocks

nanotron

Minimalistic large language model 3D-parallelism training

persona-hub

Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"

RLHF-Reward-Modeling

Recipes to train reward model for RLHF.

attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

LongBench

[ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

academy

Ray tutorials from Anyscale

LLM-Shearing

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

gpt_paper_assistant

GPT4 based personalized ArXiv paper assistant bot

FuseAI

FuseAI Project

Online-RLHF

A recipe for online RLHF and online iterative DPO.

NeuralFlow

Visualize the intermediate output of Mistral 7B

InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.