OnofreyLab / dl-hmc_miccai2022

Deep Learning Head Motion Correction - MICCAI 2022

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Supervised Deep Learning for Head Motion Correction in PET

Tianyi Zeng1, Ph.D.; Jiazhen Zhang1; Enette Revilla5, M.Sc.; Eléonore V. Lieffrig1, M.Sc.; Xi Fang2, Ph.D.; Yihuan Lu6, Ph.D.; John A. Onofrey1,3,4, Ph.D.

Cite this article

Abstract

Head movement is a major limitation in brain positron emission tomography (PET) imaging, which results in image artifacts and quantification errors. Head motion correction plays a critical role in quantitative image analysis and diagnosis of nervous system disease. However, to date, there is no approach that can track head motion continuously without using an external device. Here, we develop a deep learning-based algorithm to predict rigid motion for brain PET by leveraging existing dynamic PET scans with gold-standard motion measurements from external Polaris Vicra tracking. We propose a novel Deep Learning for Head Motion Correction (DL-HMC) methodology that consists of three components: (i) PET input data encoder layers; (ii) regression layers to estimate the six rigid transformation motion parameters; and (iii) feature-wise transformation (FWT) layers to condition the network to tracer time-activity. The input of DL-HMC is sampled pairs of one-second 3D cloud representations of the PET data and the output is the prediction of six rigid transformation motion parameters. We trained this network in a supervised manner using the Vicra motion tracking information as gold-standard. We quantitatively evaluate DL-HMC by comparing to gold-standard Vicra measurements and qualitatively evaluate the reconstructed images as well as perform region of interest standard uptake value (SUV) measurements. An algorithm ablation study was performed to determine the contributions of each of our DL-HMC design choices to network performance. Our results demonstrate accurate motion prediction performance for brain PET using a data-driven registration approach without external motion tracking hardware

DL-HMC Network architecture

Author information

Affiliations

1 Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA

2 Department of Psychiatry, Yale University, New Haven, CT, USA

3 Department of Urology, Yale University, New Haven, CT, USA

4 Department of Biomedical Engineering, Yale University, New Haven, CT, USA

5 University of California, Davis, CA, USA

6 United Imaging, Shanghai, China

Cite this article

Zeng, T. et al. (2022). Supervised Deep Learning for Head Motion Correction in PET. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13434. Springer, Cham.

DOI

https://doi.org/10.1007/978-3-031-16440-8_19

About

Deep Learning Head Motion Correction - MICCAI 2022

License:GNU General Public License v3.0


Languages

Language:Jupyter Notebook 98.6%Language:Python 1.4%