Cargando…

Exploring the performance of implicit neural representations for brain image registration

Pairwise image registration is a necessary prerequisite for brain image comparison and data integration in neuroscience and radiology. In this work, we explore the efficacy of implicit neural representations (INRs) in improving the performance of brain image registration in magnetic resonance imagin...

Descripción completa

Detalles Bibliográficos
Autores principales: Byra, Michal, Poon, Charissa, Rachmadi, Muhammad Febrian, Schlachter, Matthias, Skibbe, Henrik
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10575995/
https://www.ncbi.nlm.nih.gov/pubmed/37833464
http://dx.doi.org/10.1038/s41598-023-44517-5
_version_ 1785121031646609408
author Byra, Michal
Poon, Charissa
Rachmadi, Muhammad Febrian
Schlachter, Matthias
Skibbe, Henrik
author_facet Byra, Michal
Poon, Charissa
Rachmadi, Muhammad Febrian
Schlachter, Matthias
Skibbe, Henrik
author_sort Byra, Michal
collection PubMed
description Pairwise image registration is a necessary prerequisite for brain image comparison and data integration in neuroscience and radiology. In this work, we explore the efficacy of implicit neural representations (INRs) in improving the performance of brain image registration in magnetic resonance imaging. In this setting, INRs serve as a continuous and coordinate based approximation of the deformation field obtained through a multi-layer perceptron. Previous research has demonstrated that sinusoidal representation networks (SIRENs) surpass ReLU models in performance. In this study, we first broaden the range of activation functions to further investigate the registration performance of implicit networks equipped with activation functions that exhibit diverse oscillatory properties. Specifically, in addition to the SIRENs and ReLU, we evaluate activation functions based on snake, sine+, chirp and Morlet wavelet functions. Second, we conduct experiments to relate the hyper-parameters of the models to registration performance. Third, we propose and assess various techniques, including cycle consistency loss, ensembles and cascades of implicit networks, as well as a combined image fusion and registration objective, to enhance the performance of implicit registration networks beyond the standard approach. The investigated implicit methods are compared to the VoxelMorph convolutional neural network and to the symmetric image normalization (SyN) registration algorithm from the Advanced Normalization Tools (ANTs). Our findings not only highlight the remarkable capabilities of implicit networks in addressing pairwise image registration challenges, but also showcase their potential as a powerful and versatile off-the-shelf tool in the fields of neuroscience and radiology.
format Online
Article
Text
id pubmed-10575995
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-105759952023-10-15 Exploring the performance of implicit neural representations for brain image registration Byra, Michal Poon, Charissa Rachmadi, Muhammad Febrian Schlachter, Matthias Skibbe, Henrik Sci Rep Article Pairwise image registration is a necessary prerequisite for brain image comparison and data integration in neuroscience and radiology. In this work, we explore the efficacy of implicit neural representations (INRs) in improving the performance of brain image registration in magnetic resonance imaging. In this setting, INRs serve as a continuous and coordinate based approximation of the deformation field obtained through a multi-layer perceptron. Previous research has demonstrated that sinusoidal representation networks (SIRENs) surpass ReLU models in performance. In this study, we first broaden the range of activation functions to further investigate the registration performance of implicit networks equipped with activation functions that exhibit diverse oscillatory properties. Specifically, in addition to the SIRENs and ReLU, we evaluate activation functions based on snake, sine+, chirp and Morlet wavelet functions. Second, we conduct experiments to relate the hyper-parameters of the models to registration performance. Third, we propose and assess various techniques, including cycle consistency loss, ensembles and cascades of implicit networks, as well as a combined image fusion and registration objective, to enhance the performance of implicit registration networks beyond the standard approach. The investigated implicit methods are compared to the VoxelMorph convolutional neural network and to the symmetric image normalization (SyN) registration algorithm from the Advanced Normalization Tools (ANTs). Our findings not only highlight the remarkable capabilities of implicit networks in addressing pairwise image registration challenges, but also showcase their potential as a powerful and versatile off-the-shelf tool in the fields of neuroscience and radiology. Nature Publishing Group UK 2023-10-13 /pmc/articles/PMC10575995/ /pubmed/37833464 http://dx.doi.org/10.1038/s41598-023-44517-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Byra, Michal
Poon, Charissa
Rachmadi, Muhammad Febrian
Schlachter, Matthias
Skibbe, Henrik
Exploring the performance of implicit neural representations for brain image registration
title Exploring the performance of implicit neural representations for brain image registration
title_full Exploring the performance of implicit neural representations for brain image registration
title_fullStr Exploring the performance of implicit neural representations for brain image registration
title_full_unstemmed Exploring the performance of implicit neural representations for brain image registration
title_short Exploring the performance of implicit neural representations for brain image registration
title_sort exploring the performance of implicit neural representations for brain image registration
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10575995/
https://www.ncbi.nlm.nih.gov/pubmed/37833464
http://dx.doi.org/10.1038/s41598-023-44517-5
work_keys_str_mv AT byramichal exploringtheperformanceofimplicitneuralrepresentationsforbrainimageregistration
AT pooncharissa exploringtheperformanceofimplicitneuralrepresentationsforbrainimageregistration
AT rachmadimuhammadfebrian exploringtheperformanceofimplicitneuralrepresentationsforbrainimageregistration
AT schlachtermatthias exploringtheperformanceofimplicitneuralrepresentationsforbrainimageregistration
AT skibbehenrik exploringtheperformanceofimplicitneuralrepresentationsforbrainimageregistration