ruocwang

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

dpo-diffusion

[ICML 2024] On Discrete Prompt Optimization for Diffusion Models - Google

mixture-of-prompts

[ICML 2024] One Prompt is Not Enough: Automated Construction of a Mixture-of-Expert Prompts - TurningPoint AI

Formulate_and_Solve

Official implementation and dataset of the paper: "Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than Two Unknowns?"

DrNAS

Code for our ICLR'2021 paper "DrNAS: Dirichlet Neural Architecture Search"

GM-NAS

Code for our ICLR'2022 paper "Generalizing Few-Shot NAS with Gradient Matching"

LLM101n

LLM101n: Let's build a Storyteller

llm-symbolic-program

Official implementation: Large Language Models are Interpretable Learners - Google

DrAttack

Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers

uni2ts

[ICML2024] Unified Training of Universal Time Series Forecasting Transformers

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

AutoPrompt

A framework for prompt tuning using Intent-based Prompt Calibration

prompt-hyperopt

Improve prompts for e.g. GPT3 and GPT-J using templates and hyperparameter optimization.

Awesome-LLM-Prompt-Optimization

Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models

mulan-code

LLM-Optimizers-Papers

Must-read Papers on Large Language Model (LLM) as Optimizers and Automatic Optimization for Prompting LLMs.

pseudo-code-instructions

Pseudo-code Instructions dataset

BIG-Bench-Hard

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them

representation-engineering

Representation Engineering: A Top-Down Approach to AI Transparency

Program-of-Thoughts

Data and Code for Program of Thoughts (TMLR 2023)

Awesome-Prompt-Engineering

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

LLM-eval-survey

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

InstructZero

Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts!

Prompt-Engineering-Guide

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

LLMsPracticalGuide

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

TAADpapers

Must-read Papers on Textual Adversarial Attack and Defense

torch-fidelity

High-fidelity performance metrics for generative models in PyTorch

Structured-Diffusion-Guidance

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis