Authors: Nikhil Kumar Tomar, Debesh Jha, Michael A. Riegler, Håvard D. Johansen, Dag Johansen, Jens Rittscher, Pål Halvorsen and Sharib Ali
Research paper: https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9741842
The increase of available large clinical and exper- imental datasets has contributed to a substantial amount of important contributions in the area of biomedical image anal- ysis. Image segmentation, which is crucial for any quantitative analysis, has especially attracted attention. Recent hardware advancement has led to the success of deep learning approaches. However, although deep learning models are being trained on large datasets, existing methods do not use the information from different learning epochs effectively. In this work, we leverage the information of each training epoch to prune the prediction maps of the subsequent epochs. We propose a novel architecture called feedback attention network (FANet) that unifies the previous epoch mask with the feature map of the current training epoch. The previous epoch mask is then used to provide a hard attention to the learned feature maps at different convolutional layers. The network also allows to rectify the predictions in an iterative fashion during the test time. We show that our proposed feedback attention model provides a substantial improvement on most segmentation metrics tested on seven publicly available biomedical imaging datasets demonstrating the effectiveness of FANet.
- Kvasir-SEG
- CVC-ClinicDB
- DRIVE
- CHASE DB1
- 2018 Data Science Bowl
- ISIC 2018
- EM
Please cite our paper if you find it useful:
@article{tomar2021fanet,
title={Fanet: A feedback attention network for improved biomedical image segmentation},
author={Tomar, Nikhil Kumar and Jha, Debesh and Riegler, Michael A and Johansen, H{\aa}vard D and Johansen, Dag and Rittscher, Jens and Halvorsen, P{\aa}l and Ali, Sharib},
journal={arXiv preprint arXiv:2103.17235},
year={2021}
}
Please contact nikhilroxtomar@gmail.com and debesh@simula.no for any further questions.