harelix

LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

outlines

Structured Text Generation

trulens

Evaluation and Tracking for LLM Experiments

text-generation-inference

Large Language Model Text Generation Inference

PurpleLlama

Set of tools to assess and improve LLM security.

TruthfulQA

TruthfulQA: Measuring How Models Imitate Human Falsehoods

aws-rtb-intelligence-kit

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

bias-mitigation-foundation-models

Bias mitigation in foundation models

BentoML

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

Yatai

Model Deployment at Scale on Kubernetes 🦄️

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

fmeval

Foundation Model Evaluations Library

jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

lm-evaluation-harness

A framework for few-shot evaluation of language models.

llm-sagemaker-sample

axolotl

Go ahead and axolotl questions

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

narrator

David Attenborough narrates your life

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

fairscale

PyTorch extensions for high performance and large scale training.

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

wandb

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

aws-cdk-examples

Example projects using the AWS CDK

redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

amazon-bedrock-workshop

This is a workshop designed for Amazon Bedrock a foundational model service.

DiskANN

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search

eitans-sagemaker-examples

Amazon SageMaker Examples

dynibar

Implementation of DynIBaR Neural Dynamic Image-Based Rendering (CVPR 2023)