Cargando…
Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction
Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack tempo...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336014/ https://www.ncbi.nlm.nih.gov/pubmed/37433827 http://dx.doi.org/10.1038/s41598-023-38073-1 |
_version_ | 1785071116479365120 |
---|---|
author | Gulamhussene, Gino Rak, Marko Bashkanov, Oleksii Joeres, Fabian Omari, Jazan Pech, Maciej Hansen, Christian |
author_facet | Gulamhussene, Gino Rak, Marko Bashkanov, Oleksii Joeres, Fabian Omari, Jazan Pech, Maciej Hansen, Christian |
author_sort | Gulamhussene, Gino |
collection | PubMed |
description | Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack temporal/spatial resolution, and have long prior acquisitions or reconstruction times. Deep learning-based (DL) 4D MRI approaches promise to overcome these shortcomings but are sensitive to domain shift. This work shows that transfer learning (TL) combined with an ensembling strategy can help alleviate this key challenge. We evaluate four approaches: pre-trained models from the source domain, models directly trained from scratch on target domain data, models fine-tuned from a pre-trained model and an ensemble of fine-tuned models. For that the data base was split into 16 source and 4 target domain subjects. Comparing ensemble of fine-tuned models (N = 10) with directly learned models, we report significant improvements (P < 0.001) of the root mean squared error (RMSE) of up to 12% and the mean displacement (MDISP) of up to 17.5%. The smaller the target domain data amount, the larger the effect. This shows that TL + Ens significantly reduces beforehand acquisition time and improves reconstruction quality, rendering it a key component in making 4D MRI clinically feasible for the first time in the context of 4D organ motion models of the liver and beyond. |
format | Online Article Text |
id | pubmed-10336014 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-103360142023-07-13 Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction Gulamhussene, Gino Rak, Marko Bashkanov, Oleksii Joeres, Fabian Omari, Jazan Pech, Maciej Hansen, Christian Sci Rep Article Time-resolved volumetric magnetic resonance imaging (4D MRI) could be used to address organ motion in image-guided interventions like tumor ablation. Current 4D reconstruction techniques are unsuitable for most interventional settings because they are limited to specific breathing phases, lack temporal/spatial resolution, and have long prior acquisitions or reconstruction times. Deep learning-based (DL) 4D MRI approaches promise to overcome these shortcomings but are sensitive to domain shift. This work shows that transfer learning (TL) combined with an ensembling strategy can help alleviate this key challenge. We evaluate four approaches: pre-trained models from the source domain, models directly trained from scratch on target domain data, models fine-tuned from a pre-trained model and an ensemble of fine-tuned models. For that the data base was split into 16 source and 4 target domain subjects. Comparing ensemble of fine-tuned models (N = 10) with directly learned models, we report significant improvements (P < 0.001) of the root mean squared error (RMSE) of up to 12% and the mean displacement (MDISP) of up to 17.5%. The smaller the target domain data amount, the larger the effect. This shows that TL + Ens significantly reduces beforehand acquisition time and improves reconstruction quality, rendering it a key component in making 4D MRI clinically feasible for the first time in the context of 4D organ motion models of the liver and beyond. Nature Publishing Group UK 2023-07-11 /pmc/articles/PMC10336014/ /pubmed/37433827 http://dx.doi.org/10.1038/s41598-023-38073-1 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Gulamhussene, Gino Rak, Marko Bashkanov, Oleksii Joeres, Fabian Omari, Jazan Pech, Maciej Hansen, Christian Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title | Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title_full | Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title_fullStr | Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title_full_unstemmed | Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title_short | Transfer-learning is a key ingredient to fast deep learning-based 4D liver MRI reconstruction |
title_sort | transfer-learning is a key ingredient to fast deep learning-based 4d liver mri reconstruction |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10336014/ https://www.ncbi.nlm.nih.gov/pubmed/37433827 http://dx.doi.org/10.1038/s41598-023-38073-1 |
work_keys_str_mv | AT gulamhussenegino transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT rakmarko transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT bashkanovoleksii transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT joeresfabian transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT omarijazan transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT pechmaciej transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction AT hansenchristian transferlearningisakeyingredienttofastdeeplearningbased4dlivermrireconstruction |