Griffin98 / Segmentation_based_Semantic_Matting

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Segmantation_based_Semantic_Matting [WIP]

This repository is unofficial implementation of paper Instance Segmentation based Semantic Matting for Compositing Applications(https://arxiv.org/abs/1904.05457)

Final Results of segmenatation are great, but not as good as the results proposed in the paper.

Results

Update ( April 7, 2020 )

I will start working on this soon, and will implement whole todo list. PS: I have stumble upon some ways to improve accuracy. Will try to implement those.

ToDo:

  • OOPs Class Design
  • Improve Trimap Generation
    • Trimap Generation Stage(Feedback Loop) seems to have major impact on the final output. My current implementation is sort of lazy implemenatation by just iterating kernel size in decreasing order. Need to work on it, in order to achieve accuracy as proposed in paper.
  • Multiple Object Segmentation
    • Currently i have limited the code to segment only few instances from the COCO dataset.

Run

  1. Download Pre-trained Mask R-CNN Model from Link
  2. Download Pre-trained Deep Image Matting model from Link
  3. Place both the downloaded models in models/ directory

To Run:

python demo_end_to_end.py <input_image>

Output:

Data/foreground/ and Data/alpha