kimdanny

guidance

A guidance language for controlling large language models.

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

dspy

DSPy: The framework for programming—not prompting—foundation models

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, Groq (100+ LLMs)

open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

reader

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

LLM-As-Chatbot

LLM as a Chatbot Service

rebiber

A simple tool to update bib entries with their official information (e.g., DBLP or the ACL anthology).

fairlearn

A Python package to assess and improve fairness of machine learning models.

language

Shared repository for open-sourced projects from the Google AI Language team.

submitit

Python 3.8+ toolbox for submitting jobs to Slurm

FiD

Fusion-in-Decoder

memprompt

A method to fix GPT-3 after deployment with user feedback, without re-training.

ToolQA

ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.

LaMP

Codes for papers on Large Language Models Personalization (LaMP)

dataset_difficulty

"Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)

magix

Supercharge huggingface transformers with model parallelism.

ragged

Retrieval Augmented Generation Generalized Evaluation Dataset

yet-another-gpt-tutorial

minllama-assignment

2021-SIGIR-plackett-luce

ragbooster

text-generation-inference

An Apache 2.0 fork of HuggingFace's Large Language Model Text Generation Inference

nlp-from-scratch-assignment-spring2024

An assignment for building an NLP system from scratch.

lti-llm-deployment

pref_eval

Implementation of mulitiple preference-based evaluation for ranked lists and binary relevance.

fairranktune

FairRankTune Python Toolkit: Fairness-Aware Data Generation, Fairness Metrics, and Fair Ranking Algorithms.

bench

scripts

rank-fairness-metrics

Reproducer code for our SIGIR 2022 paper on fair ranking metrics.