veb-101 / keras-vision

Porting vision models to Keras 3 for easily accessibility. Contains MobileViT v1, MobileViT v2

Porting all models from everywhere to Keras to leverage multi-backend support.

Cause why not?🤷🏻‍♂️

Table of Contents

1. Updates
2. Quick Setup
   • Stable PyPi Package
   • Latest Git Updates
3. Models Supported

Progress

• Working on adding MobileViT v2

Updates

1. [2024-05-15] Fixed MobileViT v1 - Now works will all 3 backends. 🎉🎉
2. [2024-05-04] Converted MobileViT to Keras 3 and released weights of all 3 variants.
   1. Jax backend currently not working, I'm working on a fix.
   2. Release: https://github.com/veb-101/keras-vision/releases/tag/v0.4

Quick Setup

Stable PyPi Package

pip install -U keras-vision

OR

Latest Git Updates

pip install git+https://github.com/veb-101/keras-vision.git

Models Supported

# No.	Models	Paper	Additional Materials	Example notebook	Weights URL
1	MobileViT-V1	MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer	Blogpost: Building MobileViT In Keras 3	Colab link	Releases v0.4