Cargando…
Unsupervised knowledge-transfer for learned image reconstruction
Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develo...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
IOP Publishing
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10515400/ https://www.ncbi.nlm.nih.gov/pubmed/37745782 http://dx.doi.org/10.1088/1361-6420/ac8a91 |
_version_ | 1785108939651678208 |
---|---|
author | Barbano, Riccardo Kereta, Željko Hauptmann, Andreas Arridge, Simon R Jin, Bangti |
author_facet | Barbano, Riccardo Kereta, Željko Hauptmann, Andreas Arridge, Simon R Jin, Bangti |
author_sort | Barbano, Riccardo |
collection | PubMed |
description | Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only. |
format | Online Article Text |
id | pubmed-10515400 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | IOP Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-105154002023-09-23 Unsupervised knowledge-transfer for learned image reconstruction Barbano, Riccardo Kereta, Željko Hauptmann, Andreas Arridge, Simon R Jin, Bangti Inverse Probl Paper Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only. IOP Publishing 2022-10-01 2022-09-08 /pmc/articles/PMC10515400/ /pubmed/37745782 http://dx.doi.org/10.1088/1361-6420/ac8a91 Text en © 2022 The Author(s). Published by IOP Publishing Ltd https://creativecommons.org/licenses/by/4.0/Original content from this work may be used under the terms of the Creative Commons Attribution 4.0 licence (https://creativecommons.org/licenses/by/4.0/) . Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. |
spellingShingle | Paper Barbano, Riccardo Kereta, Željko Hauptmann, Andreas Arridge, Simon R Jin, Bangti Unsupervised knowledge-transfer for learned image reconstruction |
title | Unsupervised knowledge-transfer for learned image reconstruction
|
title_full | Unsupervised knowledge-transfer for learned image reconstruction
|
title_fullStr | Unsupervised knowledge-transfer for learned image reconstruction
|
title_full_unstemmed | Unsupervised knowledge-transfer for learned image reconstruction
|
title_short | Unsupervised knowledge-transfer for learned image reconstruction
|
title_sort | unsupervised knowledge-transfer for learned image reconstruction |
topic | Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10515400/ https://www.ncbi.nlm.nih.gov/pubmed/37745782 http://dx.doi.org/10.1088/1361-6420/ac8a91 |
work_keys_str_mv | AT barbanoriccardo unsupervisedknowledgetransferforlearnedimagereconstruction AT keretazeljko unsupervisedknowledgetransferforlearnedimagereconstruction AT hauptmannandreas unsupervisedknowledgetransferforlearnedimagereconstruction AT arridgesimonr unsupervisedknowledgetransferforlearnedimagereconstruction AT jinbangti unsupervisedknowledgetransferforlearnedimagereconstruction |