jvpassarelli / sam-clip-segmentation

Image Instance Segmentation - Zero Shot - OpenAI's CLIP + Meta's SAM

sam-clip-segmentation

Zero Shot Segmentation using Meta's SAM && OpenAI's CLIP

Installation

Install SAM: I recommend following Meta's installation instructions here

But ultimately I used the pip installation listed below:

pip install git+https://github.com/facebookresearch/segment-anything.git

Install CLIP: I recommend following CLIP instructions here

But ultimately I used the pip installation listed below:

pip install git+https://github.com/openai/CLIP.git

How to Run:

The notebook in this repo steps through generating an overlay image