Denys88 / snapml-templates

snapml-templates

This repository provides training notebooks for Lens Studio templates powered with Snap ML. Each notebook allows to train a model which then can be brought into Lens Studio project. Lens Studio download page: https://lensstudio.snapchat.com/download/ SnapML overview https://lensstudio.snapchat.com/guides/machine-learning/

Templates

Style Transfer

Allows you to train Style Transfer model based on provided image.

• Notebook https://github.com/Snapchat/snapml-templates/blob/main/Style%20Transfer/style_transfer.ipynb
• Dataset COCO dataset http://cocodataset.org/#explore
• Template is built into the Lens Studio, Category - Machine Learning
• Guide https://lensstudio.snapchat.com/templates/ml/style-transfer/

Classification

Provides an example of binary classification

• Notebook https://github.com/Snapchat/snapml-templates/blob/main/Classification/eyeglasses_classification.ipynb
• Dataset CelebA https://drive.google.com/drive/folders/0B7EVK8r0v71pWEZsZE9oNnFzTm8
• Template is built into the Lens Studio, Category - Machine Learning
• Guide https://lensstudio.snapchat.com/templates/ml/classification/

Object Detection

Provides an example of the car detection

• Notebook https://github.com/Snapchat/snapml-templates/blob/main/Object%20Detection/object_detection.ipynb
• Dataset COCO dataset http://cocodataset.org/#explore
• Template is built into the Lens Studio, Category - Machine Learning
• Template Guide - https://lensstudio.snapchat.com/templates/ml/object-detection/

Custom Segmentation

Provides an example of pizza segmentation

• Notebook https://github.com/Snapchat/snapml-templates/blob/main/Custom%20Segmentation/segmentation_training.ipynb
• Dataset COCO dataset http://cocodataset.org/#explore
• Template is built into the Lens Studio, Category - Machine Learning
• Template Guide https://lensstudio.snapchat.com/templates/ml/custom-segmentation/

Keyword Detection

Provides an example of training a model that classifies spectrogram images generated from audio.

• Notebook https://github.com/Snapchat/snapml-templates/blob/main/Keyword%20Detection/Keyword_Detection.ipynb
• Dataset SpeechCommands https://arxiv.org/abs/1804.03209
• Template is built-into the Lens Studio, category - Audio
• Template Guide https://lensstudio.snapchat.com/templates/audio/keyword-detection/

License

A license file is included with each folder project. The full license can be found here: https://lensstudio.snapchat.com/template-license