JakobWong

anthropic-tokenizer

Approximation of the Claude 3 tokenizer by inspecting generation stream

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

vit-explain

Explainability for Vision Transformers

Transformer-MM-Explainability

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

Transformer-Explainability

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

gScoreCAM

anu

Immersive Visualization Toolkit for BabylonJS

disentangling-vae

Experiments for understanding disentanglement in VAE latent representations

disentanglement_lib

disentanglement_lib is an open-source library for research on learning disentangled representations.

disent

🧶 Modular VAE disentanglement framework for python built with PyTorch Lightning ▸ Including metrics and datasets ▸ With strongly supervised, weakly supervised and unsupervised methods ▸ Easily configured and run with Hydra config ▸ Inspired by disentanglement_lib

zadu

A Python Library for Evaluating the Reliability of Dimensionality Reduction Embeddings

Multicore-TSNE

[outdated] see https://github.com/sg-s/tsne-wrappers

Awesome-Image-Quality-Assessment

A comprehensive collection of IQA papers

ConvNeXt

Code release for ConvNeXt model

AIGCIQA2023

AGIQA-3k-Database

[IEEE TCSVT2023] A Fine-grained Subjective Perception & Alignment Database for AI Generated Image Quality Assessment

CLIP-LIT

[ICCV 2023, Oral] Iterative Prompt Learning for Unsupervised Backlit Image Enhancement

IQA-PyTorch

👁️ 🖼️ 🔥PyTorch Toolbox for Image Quality Assessment, including LPIPS, FID, NIQE, NRQM(Ma), MUSIQ, TOPIQ, NIMA, DBCNN, BRISQUE, PI and more...

CLIP-IQA

[AAAI 2023] Exploring CLIP for Assessing the Look and Feel of Images

Universal-Image-Embeddings

A large-scale benchmark for the evaluation of embeddings across a number of fine-grained and instance-level visual domains.

vissl

VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.

CLIP-visualization

Attention visualization in CLIP

CAE

This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"

ViECap

Transferable Decoding with Visual Entities for Zero-Shot Image Captioning, ICCV 2023

CLIP_prefix_caption

Simple image captioning model

DeCap

ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning

vit-interpret

Official implementation of "Interpreting and Controlling Vision Foundation Models via Text Explanations"

foolbox

A Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX

adversarial-attacks-pytorch

PyTorch implementation of adversarial attacks [torchattacks]

SyntheticImagesAnalysis

Synthetic Images Analysis