AstomMars / DFDNet

Blind Face Restoration via Deep Multi-scale Component Dictionaries

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DFDNet

Overview of our proposed method. It mainly contains two parts: (a) the off-line generation of multi-scale component dictionaries from large amounts of high-quality images, which have diverse poses and expressions. K-means is adopted to generate K clusters for each component (i.e., left/right eyes, nose and mouth) on different feature scales. (b) The restoration process and dictionary feature transfer (DFT) block that are utilized to provide the reference details in a progressive manner. Here, DFT-i block takes the Scale-i component dictionaries for reference in the same feature level.

(a) Offline generation of multi-scale component dictionaries.

(b) Architecture of our DFDNet for dictionary feature transfer.

Pre-train Models and dictionaries

Downloading from the following url and put them into ./.

Testing

  1. Crop face from the whole image.
cd ./CropFace
python crop_face_dlib.py
(You can change the image path and save path in line 61~62)
  1. Compute the facial landmarks.
cd ./FaceLandmarkDetection
python get_face_landmark.py
(You can change the image path and save path in line 17~18. This code is mainly borrowed from this work)
  1. Run the face restoration.
python test_FaceDict.py
(You can directly run this code for the given test images and landmarks without step 1 and 2. The image path can be revised in line 100~103.)

Some plausible restoration results on real low-quality images

InputResults

Citation

@InProceedings{Li_2020_ECCV,
author = {Li, Xiaoming and Chen, Chaofeng and Zhou, Shangchen and Lin, Xianhui, Zuo, Wangmeng and Zhang, Lei},
title = {Blind Face Restoration via Deep Multi-scale Component Dictionaries},
booktitle = {ECCV},
year = {2020}
}
This code is released only for educational usage.

About

Blind Face Restoration via Deep Multi-scale Component Dictionaries


Languages

Language:Python 99.5%Language:Dockerfile 0.5%