saikatkumardey / CoreMLCameraVideoMatting

SwiftUI iOS app which applies CoreML Video Matting (background removal) model to the front camera stream

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CoreML Camera Video Matting with Facial Emotions Recognition

This is a simple iOS app which applies Video Matting (background removal) model to the front camera stream. Video Matting is performed using pre-trained CoreML model from Robust Video Matting project. Also, a custom classifier was trained on this dataset to select backgrounds according to facial emotions.

App is implemented using SwiftUI.

Launch instructions

Tested using the following environment:

  1. Xcode Version 13.2.1 (13C100)
  2. 1.26.21 Apple Swift version 5.5.2

The project doesn't require any external dependencies or resources so just pull the repo and open the project in Xcode.

NOTE: since the app uses camera, it won't work in emulator - you need a PHYSICAL iOS device to run it.

About

SwiftUI iOS app which applies CoreML Video Matting (background removal) model to the front camera stream

License:GNU General Public License v3.0


Languages

Language:Swift 100.0%