syncdoth

honest_llama

Inference-Time Intervention: Eliciting Truthful Answers from a Language Model

Knowledge-Constrained-Decoding

Official Code for EMNLP2023 Main Conference paper: "KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection"

yet-another-retnet

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)

WizardLM

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

llm-reasoners

A library for advanced large language model reasoning

RetNet

Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent, and chunkwise forward.

deep-thinking

A centralized place for deep thinking code and experiments

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

teaching_arithmetic

flacuna

Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

CAR

Code for the EMNLP2023 Findings paper: CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering (https://aclanthology.org/2023.findings-emnlp.902.pdf).

ijepa

Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive architecture."

KID

Knowledge Infused Decoding

korean-safety-benchmarks

Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)

MFMA

Factual consistency checking model for abstractive summaries (NAACL-22 Findings)

diff-svc

Singing Voice Conversion via diffusion model

bark

🔊 Text-Prompted Generative Audio Model

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

YourTTS

YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyone

fed

Code for SIGdial 2020 paper: Unsupervised Evaluation of Interactive Dialog with DialoGPT (https://arxiv.org/abs/2006.12719)

qlora

QLoRA: Efficient Finetuning of Quantized LLMs

Implicit-Language-Q-Learning

Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"

KnowledGPT

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

COLA

Official code repository for the main conference paper in ACL2023: COLA: Contextualized Commonsense Causality Reasoning from the Causal Inference Perspective

OpenAlpaca

OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA

awesome-mlops

A curated list of references for MLOps