Cargando…

Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators

In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to app...

Descripción completa

Detalles Bibliográficos
Autores principales: Evangelista, Davide, Morotti, Elena, Piccolomini, Elena Loli, Nagy, James
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10381581/
https://www.ncbi.nlm.nih.gov/pubmed/37504810
http://dx.doi.org/10.3390/jimaging9070133
_version_ 1785080479591956480
author Evangelista, Davide
Morotti, Elena
Piccolomini, Elena Loli
Nagy, James
author_facet Evangelista, Davide
Morotti, Elena
Piccolomini, Elena Loli
Nagy, James
author_sort Evangelista, Davide
collection PubMed
description In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to approximate when noise affects the data. Really, one limitation of neural networks for deblurring is their sensitivity to noise and other perturbations, which can lead to instability and produce poor reconstructions. In addition, networks do not necessarily take into account the numerical formulation of the underlying imaging problem when trained end-to-end. In this paper, we propose some strategies to improve stability without losing too much accuracy to deblur images with deep-learning-based methods. First, we suggest a very small neural architecture, which reduces the execution time for training, satisfying a green AI need, and does not extremely amplify noise in the computed image. Second, we introduce a unified framework where a pre-processing step balances the lack of stability of the following neural-network-based step. Two different pre-processors are presented. The former implements a strong parameter-free denoiser, and the latter is a variational-model-based regularized formulation of the latent imaging problem. This framework is also formally characterized by mathematical analysis. Numerical experiments are performed to verify the accuracy and stability of the proposed approaches for image deblurring when unknown or not-quantified noise is present; the results confirm that they improve the network stability with respect to noise. In particular, the model-based framework represents the most reliable trade-off between visual precision and robustness.
format Online
Article
Text
id pubmed-10381581
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103815812023-07-29 Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators Evangelista, Davide Morotti, Elena Piccolomini, Elena Loli Nagy, James J Imaging Article In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an ill-posed inverse problem and its solution is difficult to approximate when noise affects the data. Really, one limitation of neural networks for deblurring is their sensitivity to noise and other perturbations, which can lead to instability and produce poor reconstructions. In addition, networks do not necessarily take into account the numerical formulation of the underlying imaging problem when trained end-to-end. In this paper, we propose some strategies to improve stability without losing too much accuracy to deblur images with deep-learning-based methods. First, we suggest a very small neural architecture, which reduces the execution time for training, satisfying a green AI need, and does not extremely amplify noise in the computed image. Second, we introduce a unified framework where a pre-processing step balances the lack of stability of the following neural-network-based step. Two different pre-processors are presented. The former implements a strong parameter-free denoiser, and the latter is a variational-model-based regularized formulation of the latent imaging problem. This framework is also formally characterized by mathematical analysis. Numerical experiments are performed to verify the accuracy and stability of the proposed approaches for image deblurring when unknown or not-quantified noise is present; the results confirm that they improve the network stability with respect to noise. In particular, the model-based framework represents the most reliable trade-off between visual precision and robustness. MDPI 2023-06-30 /pmc/articles/PMC10381581/ /pubmed/37504810 http://dx.doi.org/10.3390/jimaging9070133 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Evangelista, Davide
Morotti, Elena
Piccolomini, Elena Loli
Nagy, James
Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title_full Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title_fullStr Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title_full_unstemmed Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title_short Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
title_sort ambiguity in solving imaging inverse problems with deep-learning-based operators
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10381581/
https://www.ncbi.nlm.nih.gov/pubmed/37504810
http://dx.doi.org/10.3390/jimaging9070133
work_keys_str_mv AT evangelistadavide ambiguityinsolvingimaginginverseproblemswithdeeplearningbasedoperators
AT morottielena ambiguityinsolvingimaginginverseproblemswithdeeplearningbasedoperators
AT piccolominielenaloli ambiguityinsolvingimaginginverseproblemswithdeeplearningbasedoperators
AT nagyjames ambiguityinsolvingimaginginverseproblemswithdeeplearningbasedoperators