Yohan's starred repositories
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
awesome-RLHF
A curated list of reinforcement learning with human feedback resources (continually updated)
GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
TransformerLens
A library for mechanistic interpretability of GPT-style language models
langkit
🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
inspect_ai
Inspect: A framework for large language model evaluations
tuned-lens
Tools for understanding how transformer predictions are built layer-by-layer
steering-vectors
Steering vectors for transformer language models in Pytorch / Huggingface
Text-Steganography-Benchmark
Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.
democracy-ai-hackathon
This repository contains code for the Democracy x AI Hackathon by Apart Research