hellbell

unsloth

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

IP-Adapter

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

consistencydecoder

Consistency Distilled Diff VAE

moco-v3

PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057

MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

LLM-Reading-List

LLM papers I'm reading, mostly on inference and model compression

landmark-attention

Landmark Attention: Random-Access Infinite Context Length for Transformers

open_lm

A repository for research on medium sized language models.

gisting

Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467

vision-language-models-are-bows

Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR 2023

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

ConceptBottleneck

Concept Bottleneck Models, ICML 2020

SEARLE

[ICCV 2023] - Zero-shot Composed Image Retrieval with Textual Inversion

meru

Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023

tcl

Official implementation of TCL (CVPR 2023)

SRe2L

(NeurIPS 2023 spotlight) Large-scale Dataset Distillation/Condensation, 50 IPC (Images Per Class) achieves the highest 60.8% on original ImageNet-1K val set.

lincir

Official Pytorch implementation of LinCIR: Language-only Training of Zero-shot Composed Image Retrieval (CVPR 2024)

close

CLIP-Parrot-Bias

Parrot Captions Teach CLIP to Spot Text

WaffleCLIP

Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts"

Context-Memory

Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)

pause-transformer

Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token

dual-teacher

Official code for the NeurIPS 2023 paper "Switching Temporary Teachers for Semi-Supervised Semantic Segmentation"

clippy

Perceptual Grouping in Contrastive Vision-Language Models (ICCV'23)

PTIR

Paper Today I Read

imagenet-12k

ImageNet-12k subset of ImageNet-21k (fall11)

Neural-Relation-Graph

Official PyTorch implementation of "Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data" (NeurIPS'23)

tokenadapt

STAI-tuned

Utility code from STAI (https://scalabletrustworthyai.github.io/)