Cargando…

State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures

In modern digital microscopy, deconvolution methods are widely used to eliminate a number of image defects and increase resolution. In this review, we have divided these methods into classical, deep learning-based, and optimization-based methods. The review describes the major architectures of neura...

Descripción completa

Detalles Bibliográficos
Autores principales: Makarkin, Mikhail, Bratashov, Daniil
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8707587/
https://www.ncbi.nlm.nih.gov/pubmed/34945408
http://dx.doi.org/10.3390/mi12121558
_version_ 1784622472749907968
author Makarkin, Mikhail
Bratashov, Daniil
author_facet Makarkin, Mikhail
Bratashov, Daniil
author_sort Makarkin, Mikhail
collection PubMed
description In modern digital microscopy, deconvolution methods are widely used to eliminate a number of image defects and increase resolution. In this review, we have divided these methods into classical, deep learning-based, and optimization-based methods. The review describes the major architectures of neural networks, such as convolutional and generative adversarial networks, autoencoders, various forms of recurrent networks, and the attention mechanism used for the deconvolution problem. Special attention is paid to deep learning as the most powerful and flexible modern approach. The review describes the major architectures of neural networks used for the deconvolution problem. We describe the difficulties in their application, such as the discrepancy between the standard loss functions and the visual content and the heterogeneity of the images. Next, we examine how to deal with this by introducing new loss functions, multiscale learning, and prior knowledge of visual content. In conclusion, a review of promising directions and further development of deconvolution methods in microscopy is given.
format Online
Article
Text
id pubmed-8707587
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-87075872021-12-25 State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures Makarkin, Mikhail Bratashov, Daniil Micromachines (Basel) Review In modern digital microscopy, deconvolution methods are widely used to eliminate a number of image defects and increase resolution. In this review, we have divided these methods into classical, deep learning-based, and optimization-based methods. The review describes the major architectures of neural networks, such as convolutional and generative adversarial networks, autoencoders, various forms of recurrent networks, and the attention mechanism used for the deconvolution problem. Special attention is paid to deep learning as the most powerful and flexible modern approach. The review describes the major architectures of neural networks used for the deconvolution problem. We describe the difficulties in their application, such as the discrepancy between the standard loss functions and the visual content and the heterogeneity of the images. Next, we examine how to deal with this by introducing new loss functions, multiscale learning, and prior knowledge of visual content. In conclusion, a review of promising directions and further development of deconvolution methods in microscopy is given. MDPI 2021-12-14 /pmc/articles/PMC8707587/ /pubmed/34945408 http://dx.doi.org/10.3390/mi12121558 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Makarkin, Mikhail
Bratashov, Daniil
State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title_full State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title_fullStr State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title_full_unstemmed State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title_short State-of-the-Art Approaches for Image Deconvolution Problems, including Modern Deep Learning Architectures
title_sort state-of-the-art approaches for image deconvolution problems, including modern deep learning architectures
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8707587/
https://www.ncbi.nlm.nih.gov/pubmed/34945408
http://dx.doi.org/10.3390/mi12121558
work_keys_str_mv AT makarkinmikhail stateoftheartapproachesforimagedeconvolutionproblemsincludingmoderndeeplearningarchitectures
AT bratashovdaniil stateoftheartapproachesforimagedeconvolutionproblemsincludingmoderndeeplearningarchitectures