Cargando…

Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction

Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack tempo...

Descripción completa

Detalles Bibliográficos
Autores principales: Gulamhussene, Gino, Rak, Marko, Bashkanov, Oleksii, Joeres, Fabian, Omari, Jazan, Pech, Maciej, Hansen, Christian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336014/
https://www.ncbi.nlm.nih.gov/pubmed/37433827
http://dx.doi.org/10.1038/s41598-023-38073-1
_version_ 1785071116479365120
author Gulamhussene, Gino
Rak, Marko
Bashkanov, Oleksii
Joeres, Fabian
Omari, Jazan
Pech, Maciej
Hansen, Christian
author_facet Gulamhussene, Gino
Rak, Marko
Bashkanov, Oleksii
Joeres, Fabian
Omari, Jazan
Pech, Maciej
Hansen, Christian
author_sort Gulamhussene, Gino
collection PubMed
description Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack temporal/spatial resolution, and have long prior acquisitions or reconstruction times. Deep learning-based (DL) 4D MRI approaches promise to overcome these shortcomings but are sensitive to domain shift. This work shows that transfer learning (TL) combined with an ensembling strategy can help alleviate this key challenge. We evaluate four approaches: pre-trained models from the source domain, models directly trained from scratch on target domain data, models fine-tuned from a pre-trained model and an ensemble of fine-tuned models. For that the data base was split into 16 source and 4 target domain subjects. Comparing ensemble of fine-tuned models (N = 10) with directly learned models, we report significant improvements (P < 0.001) of the root mean squared error (RMSE) of up to 12% and the mean displacement (MDISP) of up to 17.5%. The smaller the target domain data amount, the larger the effect. This shows that TL + Ens significantly reduces beforehand acquisition time and improves reconstruction quality, rendering it a key component in making 4D MRI clinically feasible for the first time in the context of 4D organ motion models of the liver and beyond.
format Online
Article
Text
id pubmed-10336014
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-103360142023-07-13 Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction Gulamhussene, Gino Rak, Marko Bashkanov, Oleksii Joeres, Fabian Omari, Jazan Pech, Maciej Hansen, Christian Sci Rep Article Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack temporal/spatial resolution, and have long prior acquisitions or reconstruction times. Deep learning-based (DL) 4D MRI approaches promise to overcome these shortcomings but are sensitive to domain shift. This work shows that transfer learning (TL) combined with an ensembling strategy can help alleviate this key challenge. We evaluate four approaches: pre-trained models from the source domain, models directly trained from scratch on target domain data, models fine-tuned from a pre-trained model and an ensemble of fine-tuned models. For that the data base was split into 16 source and 4 target domain subjects. Comparing ensemble of fine-tuned models (N = 10) with directly learned models, we report significant improvements (P < 0.001) of the root mean squared error (RMSE) of up to 12% and the mean displacement (MDISP) of up to 17.5%. The smaller the target domain data amount, the larger the effect. This shows that TL + Ens significantly reduces beforehand acquisition time and improves reconstruction quality, rendering it a key component in making 4D MRI clinically feasible for the first time in the context of 4D organ motion models of the liver and beyond. Nature Publishing Group UK 2023-07-11 /pmc/articles/PMC10336014/ /pubmed/37433827 http://dx.doi.org/10.1038/s41598-023-38073-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Gulamhussene, Gino
Rak, Marko
Bashkanov, Oleksii
Joeres, Fabian
Omari, Jazan
Pech, Maciej
Hansen, Christian
Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title_full Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title_fullStr Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title_full_unstemmed Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title_short Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
title_sort transfer-learning is a key ingredient to fast deep learning-based 4d liver mri reconstruction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336014/
https://www.ncbi.nlm.nih.gov/pubmed/37433827
http://dx.doi.org/10.1038/s41598-023-38073-1
work_keys_str_mv AT gulamhussenegino transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT rakmarko transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT bashkanovoleksii transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT joeresfabian transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT omarijazan transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT pechmaciej transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction
AT hansenchristian transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction