Harel Gal's starred repositories
llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
text-generation-inference
Large Language Model Text Generation Inference
lm-evaluation-harness
A framework for few-shot evaluation of language models.
aws-cdk-examples
Example projects using the AWS CDK
PurpleLlama
Set of tools to assess and improve LLM security.
LLMDataHub
A quick guide (especially) for trending instruction finetuning datasets
jailbreak_llms
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
TruthfulQA
TruthfulQA: Measuring How Models Imitate Human Falsehoods
eitans-sagemaker-examples
Amazon SageMaker Examples
bias-mitigation-foundation-models
Bias mitigation in foundation models
amazon-bedrock-workshop
This is a workshop designed for Amazon Bedrock a foundational model service.