SkalskiP / fashion-assistant

Our idea is to combine the power of computer vision model and LLMs. We use YOLO, CLIP and DINOv2 to extract high-level features from images. We pass the prompt, along with the extracted features, to LLM, allowing for advanced image dataset queries.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Github Stars Roboflow Dataset

AI fashion assistant

project logo

👋 hello

Our idea is to combine the power of computer vision model and LLMs. We use YOLO, CLIP and DINOv2 to extract high-level features from images. Then we use natural language as an interface for the user. We pass the prompt, along with the extracted features, to LLM, allowing for advanced image dataset queries.

fashion-assistant-diagram

🎯 goals

Keep in mind that the project is still under 🚧 construction. We will successively publish updates and new features. Follow me on Twitter to stay up to date.

  • Help me compose my outfit based on clothes from my closet.
  • Rate my outfit.
  • Help me search online for clothes that fit my style or for a special occasion.

🖼️ image dataset

You have a project idea and would like to use our data? No problem! Our data, just like codebase is open-source. Take a peek at our Roboflow project to access images and annotations.

🦸 contribution

Do you want to help me?

  • Let GitHub know we're doing something cool here! - Leave a ⭐!
  • Contribute to our open-source dataset.
  • Help us build advanced computer vision and natural language processing features.

About

Our idea is to combine the power of computer vision model and LLMs. We use YOLO, CLIP and DINOv2 to extract high-level features from images. We pass the prompt, along with the extracted features, to LLM, allowing for advanced image dataset queries.

License:MIT License


Languages

Language:Jupyter Notebook 100.0%