Cargando…
SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images
We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an op...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8891043/ https://www.ncbi.nlm.nih.gov/pubmed/34587005 http://dx.doi.org/10.1109/TMI.2021.3116879 |
_version_ | 1784661784183963648 |
---|---|
author | Hoffmann, Malte Billot, Benjamin Greve, Douglas N. Iglesias, Juan Eugenio Fischl, Bruce Dalca, Adrian V. |
author_facet | Hoffmann, Malte Billot, Benjamin Greve, Douglas N. Iglesias, Juan Eugenio Fischl, Bruce Dalca, Adrian V. |
author_sort | Hoffmann, Malte |
collection | PubMed |
description | We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph. |
format | Online Article Text |
id | pubmed-8891043 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
record_format | MEDLINE/PubMed |
spelling | pubmed-88910432022-03-03 SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images Hoffmann, Malte Billot, Benjamin Greve, Douglas N. Iglesias, Juan Eugenio Fischl, Bruce Dalca, Adrian V. IEEE Trans Med Imaging Article We introduce a strategy for learning image registration without acquired imaging data, producing powerful networks agnostic to contrast introduced by magnetic resonance imaging (MRI). While classical registration methods accurately estimate the spatial correspondence between images, they solve an optimization problem for every new image pair. Learning-based techniques are fast at test time but limited to registering images with contrasts and geometric content similar to those seen during training. We propose to remove this dependency on training data by leveraging a generative strategy for diverse synthetic label maps and images that exposes networks to a wide range of variability, forcing them to learn more invariant features. This approach results in powerful networks that accurately generalize to a broad array of MRI contrasts. We present extensive experiments with a focus on 3D neuroimaging, showing that this strategy enables robust and accurate registration of arbitrary MRI contrasts even if the target contrast is not seen by the networks during training. We demonstrate registration accuracy surpassing the state of the art both within and across contrasts, using a single model. Critically, training on arbitrary shapes synthesized from noise distributions results in competitive performance, removing the dependency on acquired data of any kind. Additionally, since anatomical label maps are often available for the anatomy of interest, we show that synthesizing images from these dramatically boosts performance, while still avoiding the need for real intensity images. Our code is available at https://w3id.org/synthmorph. 2022-03 2022-03-02 /pmc/articles/PMC8891043/ /pubmed/34587005 http://dx.doi.org/10.1109/TMI.2021.3116879 Text en https://creativecommons.org/licenses/by/4.0/This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/ |
spellingShingle | Article Hoffmann, Malte Billot, Benjamin Greve, Douglas N. Iglesias, Juan Eugenio Fischl, Bruce Dalca, Adrian V. SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title | SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title_full | SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title_fullStr | SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title_full_unstemmed | SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title_short | SynthMorph: Learning Contrast-Invariant Registration Without Acquired Images |
title_sort | synthmorph: learning contrast-invariant registration without acquired images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8891043/ https://www.ncbi.nlm.nih.gov/pubmed/34587005 http://dx.doi.org/10.1109/TMI.2021.3116879 |
work_keys_str_mv | AT hoffmannmalte synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages AT billotbenjamin synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages AT grevedouglasn synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages AT iglesiasjuaneugenio synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages AT fischlbruce synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages AT dalcaadrianv synthmorphlearningcontrastinvariantregistrationwithoutacquiredimages |