Cargando…

Unsupervised knowledge-transfer for learned image reconstruction

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develo...

Descripción completa

Detalles Bibliográficos
Autores principales: Barbano, Riccardo, Kereta, Željko, Hauptmann, Andreas, Arridge, Simon R, Jin, Bangti
Formato: Online Artículo Texto
Lenguaje:English
Publicado: IOP Publishing 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10515400/
https://www.ncbi.nlm.nih.gov/pubmed/37745782
http://dx.doi.org/10.1088/1361-6420/ac8a91
_version_ 1785108939651678208
author Barbano, Riccardo
Kereta, Željko
Hauptmann, Andreas
Arridge, Simon R
Jin, Bangti
author_facet Barbano, Riccardo
Kereta, Željko
Hauptmann, Andreas
Arridge, Simon R
Jin, Bangti
author_sort Barbano, Riccardo
collection PubMed
description Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.
format Online
Article
Text
id pubmed-10515400
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher IOP Publishing
record_format MEDLINE/PubMed
spelling pubmed-105154002023-09-23 Unsupervised knowledge-transfer for learned image reconstruction Barbano, Riccardo Kereta, Željko Hauptmann, Andreas Arridge, Simon R Jin, Bangti Inverse Probl Paper Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only. IOP Publishing 2022-10-01 2022-09-08 /pmc/articles/PMC10515400/ /pubmed/37745782 http://dx.doi.org/10.1088/1361-6420/ac8a91 Text en © 2022 The Author(s). Published by IOP Publishing Ltd https://creativecommons.org/licenses/by/4.0/Original content from this work may be used under the terms of the Creative Commons Attribution 4.0 licence (https://creativecommons.org/licenses/by/4.0/) . Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
spellingShingle Paper
Barbano, Riccardo
Kereta, Željko
Hauptmann, Andreas
Arridge, Simon R
Jin, Bangti
Unsupervised knowledge-transfer for learned image reconstruction
title Unsupervised knowledge-transfer for learned image reconstruction
title_full Unsupervised knowledge-transfer for learned image reconstruction
title_fullStr Unsupervised knowledge-transfer for learned image reconstruction
title_full_unstemmed Unsupervised knowledge-transfer for learned image reconstruction
title_short Unsupervised knowledge-transfer for learned image reconstruction
title_sort unsupervised knowledge-transfer for learned image reconstruction
topic Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10515400/
https://www.ncbi.nlm.nih.gov/pubmed/37745782
http://dx.doi.org/10.1088/1361-6420/ac8a91
work_keys_str_mv AT barbanoriccardo unsupervisedknowledgetransferforlearnedimagereconstruction
AT keretazeljko unsupervisedknowledgetransferforlearnedimagereconstruction
AT hauptmannandreas unsupervisedknowledgetransferforlearnedimagereconstruction
AT arridgesimonr unsupervisedknowledgetransferforlearnedimagereconstruction
AT jinbangti unsupervisedknowledgetransferforlearnedimagereconstruction