Martin's starred repositories
Forecasting-Model-Search
A system for automating selection and optimization of pre-trained models from the TAO Model Zoo
LLM-Extrapolation
Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
abliterator
Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens
khoj
Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.
PyTorch-SM3
Implements the SM3-II adaptive optimization algorithm for PyTorch.
Online-RLHF
A recipe for online RLHF.
LLaMAntino-3-ANITA
The 🌟ANITA project🌟 *(Advanced Natural-based interaction for the ITAlian language)* wants to provide Italian NLP researchers with an improved model the for Italian Language 🇮🇹 use cases.
auto-round
Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"
TransformerLens
A library for mechanistic interpretability of GPT-style language models
GPT-SoVITS
1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
ThunderKittens
Tile primitives for speedy kernels
TransformerCompression
For releasing code related to compression methods for transformers, accompanying our publications