hoagy-davis-digges

CyberChef

The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis

marker

Convert PDF to markdown quickly with high accuracy

sharedrop

Easy P2P file transfer powered by WebRTC - inspired by Apple AirDrop

vanna

🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using RAG 🔄.

surya

OCR, layout analysis, reading order, line detection in 90+ languages

AlphaCodium

Official implementation for the paper: "Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineering""

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Vim

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

nanotron

Minimalistic large language model 3D-parallelism training

tensordict

TensorDict is a pytorch dedicated tensor container.

HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

wanda

A simple and effective LLM pruning approach.

EAGLE

[ICML'24] EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

SwiftInfer

Efficient AI Inference & Serving

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

ALMA

State-of-the-art LLM-based translation models.

xmc.dspy

In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.

openlogprobs

Extract full next-token probabilities via language model APIs

laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'

SeeClick

The model, data and code for the visual GUI Agent SeeClick

lq-lora

genalog

Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and text alignment capabilities.

ClusterLLM

LLM guided text clustering

LLM-MCQ-Bias

Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"

EnsembleForecasting

Using multiple LLMs for ensemble Forecasting

BiTA

An innovative method expediting LLMs via streamlined semi-autoregressive generation and draft verification.

admm-pruning