harelix

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

wandb

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

text-generation-inference

Large Language Model Text Generation Inference

outlines

Structured Text Generation

axolotl

Go ahead and axolotl questions

BentoML

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

lm-evaluation-harness

A framework for few-shot evaluation of language models.

aws-cdk-examples

Example projects using the AWS CDK

narrator

David Attenborough narrates your life

fairscale

PyTorch extensions for high performance and large scale training.

PurpleLlama

Set of tools to assess and improve LLM security.

LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

trulens

Evaluation and Tracking for LLM Experiments

jailbreak_llms

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

hh-rlhf

Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"

DiskANN

Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search

detoxify

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

dynibar

Implementation of DynIBaR Neural Dynamic Image-Based Rendering (CVPR 2023)

Yatai

Model Deployment at Scale on Kubernetes 🦄️

TruthfulQA

TruthfulQA: Measuring How Models Imitate Human Falsehoods

fmeval

Foundation Model Evaluations Library

llm-sagemaker-sample

aws-rtb-intelligence-kit

eitans-sagemaker-examples

Amazon SageMaker Examples

bias-mitigation-foundation-models

Bias mitigation in foundation models

amazon-bedrock-workshop

This is a workshop designed for Amazon Bedrock a foundational model service.