qpitlove / design-system-detector

Custom object detection for UI of the design system using TensorFlow

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

design-system-detector

TensorFlow 2.6 Python 3.6

Collection of models that automatically find UI components of design systems on design screens such as Figma or Zeplin.

I provide a collection of detection models custom trained on the UI data of Mobbin and RICO. These models can be useful for out-of-the-box inference if you are interested in the design systems.

They are also useful for initializing your models when training on your UI design assets. Please look at this blog guide and my Mobbin-training Colab for more details.

Dataset Model name Backbone Training Note
Mobbin Saved Model
Web Model
SSD MobileNet V2 FPNLite 640x640 50,000 steps Tensorboard
Mobbin Saved Model
Web Model
SSD MobileNet V2 FPNLite 640x640 7,800 steps Colab
Mobbin Saved Model
Web Model
SSD ResNet50 V1 FPN 640x640 25,000 steps Tensorboard
RICO Saved Model
Web Model
SSD MobileNet V2 FPNLite 640x640 50,000 steps Tensorboard
RICO TF Lite Model EfficientNet-lite 74,540 steps Colab
RICO Saved Model
Web Model
SSD MobileNet V2 FPNLite 640x640 7,800 steps
RICO Saved Model
Web Model
SSD ResNet50 V1 FPN 640x640 25,000 steps Tensorboard

Thanks to...

Specifically thank you to my friend who rented me his computing resources.

About

Custom object detection for UI of the design system using TensorFlow

License:MIT License


Languages

Language:Jupyter Notebook 99.8%Language:Python 0.2%