raijinspecial / Deep-rPPG

Deep learning (neural network) based remote photoplethysmography: how to extract pulse signal from video using deep learning tools

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Deep-rPPG

Deep learning (neural network) based remote photoplethysmography: how to extract pulse signal from video using deep learning tools

Implemented networks

DeepPhys

Chen, Weixuan, and Daniel McDuff. "Deepphys: Video-based physiological measurement using convolutional attention networks." Proceedings of the European Conference on Computer Vision (ECCV). 2018.

PhysNet

Yu, Zitong, Xiaobai Li, and Guoying Zhao. "Remote photoplethysmograph signal measurement from facial videos using spatio-temporal networks." Proc. BMVC. 2019.

Special application on neonates

A custom YOLO network is used to crop the baby as a preprocessing step. This network was created based on this repo: https://github.com/eriklindernoren/PyTorch-YOLOv3

Our modified version: https://github.com/terbed/PyTorch-YOLOv3

NVIDIA Jetson Nano inference

The running speed of the networks are tested on NVIDIA Jetson Nano. Results and the installation steps of PyTorch and OpenCV are in the nano folder.

About

Deep learning (neural network) based remote photoplethysmography: how to extract pulse signal from video using deep learning tools


Languages

Language:Python 93.7%Language:Shell 6.3%