Suzie Oh's starred repositories
synthesizer
A multi-purpose LLM framework for RAG and data creation.
Skywork-MoE
Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
awesome-japanese-llm
日本語LLMまとめ - Overview of Japanese LLMs
anthropic-cookbook
A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.
CALM-pytorch
Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
EasyContext
Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
Perplexica
Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
augmentoolkit
Convert Compute And Books Into Instruct-Tuning Datasets (or classifiers)!
llamaduo
This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM. For this project, we have initially chosen Gemini 1.0 Pro for service type LLM and Gemma 2B/7B for small sized LLM model. It now supports other service LLMs such as GPT4 and Claude3.
Phi-3CookBook
This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.
textbook_quality
Generate textbook-quality synthetic LLM pretraining data
Vodalus-Expert-LLM-Forge
Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation editor Gradio UI.
AutoCrawler
Official implement of paper "AutoCrawler: A Progressive Understanding Web Agent for Web Crawler Generation"
nlp-datasets
Curation note of NLP datasets