Cargando…

SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images

We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an op...

Descripción completa

Detalles Bibliográficos
Autores principales: Hoffmann, Malte, Billot, Benjamin, Greve, Douglas N., Iglesias, Juan Eugenio, Fischl, Bruce, Dalca, Adrian V.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8891043/
https://www.ncbi.nlm.nih.gov/pubmed/34587005
http://dx.doi.org/10.1109/TMI.2021.3116879
_version_ 1784661784183963648
author Hoffmann, Malte
Billot, Benjamin
Greve, Douglas N.
Iglesias, Juan Eugenio
Fischl, Bruce
Dalca, Adrian V.
author_facet Hoffmann, Malte
Billot, Benjamin
Greve, Douglas N.
Iglesias, Juan Eugenio
Fischl, Bruce
Dalca, Adrian V.
author_sort Hoffmann, Malte
collection PubMed
description We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph.
format Online
Article
Text
id pubmed-8891043
institution National Center for Biotechnology Information
language English
publishDate 2022
record_format MEDLINE/PubMed
spelling pubmed-88910432022-03-03 SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images Hoffmann, Malte Billot, Benjamin Greve, Douglas N. Iglesias, Juan Eugenio Fischl, Bruce Dalca, Adrian V. IEEE Trans Med Imaging Article We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph. 2022-03 2022-03-02 /pmc/articles/PMC8891043/ /pubmed/34587005 http://dx.doi.org/10.1109/TMI.2021.3116879 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Hoffmann, Malte
Billot, Benjamin
Greve, Douglas N.
Iglesias, Juan Eugenio
Fischl, Bruce
Dalca, Adrian V.
SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title_full SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title_fullStr SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title_full_unstemmed SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title_short SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
title_sort synthmorph: learning contrast-invariant registration without acquired images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8891043/
https://www.ncbi.nlm.nih.gov/pubmed/34587005
http://dx.doi.org/10.1109/TMI.2021.3116879
work_keys_str_mv AT hoffmannmalte synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages
AT billotbenjamin synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages
AT grevedouglasn synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages
AT iglesiasjuaneugenio synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages
AT fischlbruce synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages
AT dalcaadrianv synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages