Cargando…

An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism

The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections a...

Descripción completa

Detalles Bibliográficos
Autores principales: Lian, Zuozheng, Wang, Haizhen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10696086/
https://www.ncbi.nlm.nih.gov/pubmed/38049485
http://dx.doi.org/10.1038/s41598-023-47768-4
_version_ 1785154498349498368
author Lian, Zuozheng
Wang, Haizhen
author_facet Lian, Zuozheng
Wang, Haizhen
author_sort Lian, Zuozheng
collection PubMed
description The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections across various hierarchical levels, resulting in inadequate receptive fields and suboptimal deblurring outcomes. In U-Net, a more adaptable approach is employed, integrating diverse levels of features effectively. Such design not only significantly reduces the number of parameters but also maintains an acceptable accuracy range. Based on such advantages, an improved U-Net model for enhancing the image deblurring effect was proposed in the present study. Firstly, the model structure was designed, incorporating two key components: the MLFF (multilayer feature fusion) module and the DMRFAB (dense multi-receptive field attention block). The aim of these modules is to improve the feature extraction ability. The MLFF module facilitates the integration of feature information across various layers, while the DMRFAB module, enriched with an attention mechanism, extracts crucial and intricate image details, thereby enhancing the overall information extraction process. Finally, in combination with fast Fourier transform, the FRLF (Frequency Reconstruction Loss Function) was proposed. The FRLF obtains the frequency value of the image by reducing the frequency difference. The present experiment results reveal that the proposed method exhibited higher-quality visual effects. Specifically, for the GoPro dataset, the PSNR (peak signal-to-noise ratio) reached 31.53, while the SSIM (structural similarity index) attained a value of 0.948. Additionally, for the Real Blur dataset, the PSNR achieved 31.32, accompanied by an SSIM score of 0.934.
format Online
Article
Text
id pubmed-10696086
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-106960862023-12-06 An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism Lian, Zuozheng Wang, Haizhen Sci Rep Article The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections across various hierarchical levels, resulting in inadequate receptive fields and suboptimal deblurring outcomes. In U-Net, a more adaptable approach is employed, integrating diverse levels of features effectively. Such design not only significantly reduces the number of parameters but also maintains an acceptable accuracy range. Based on such advantages, an improved U-Net model for enhancing the image deblurring effect was proposed in the present study. Firstly, the model structure was designed, incorporating two key components: the MLFF (multilayer feature fusion) module and the DMRFAB (dense multi-receptive field attention block). The aim of these modules is to improve the feature extraction ability. The MLFF module facilitates the integration of feature information across various layers, while the DMRFAB module, enriched with an attention mechanism, extracts crucial and intricate image details, thereby enhancing the overall information extraction process. Finally, in combination with fast Fourier transform, the FRLF (Frequency Reconstruction Loss Function) was proposed. The FRLF obtains the frequency value of the image by reducing the frequency difference. The present experiment results reveal that the proposed method exhibited higher-quality visual effects. Specifically, for the GoPro dataset, the PSNR (peak signal-to-noise ratio) reached 31.53, while the SSIM (structural similarity index) attained a value of 0.948. Additionally, for the Real Blur dataset, the PSNR achieved 31.32, accompanied by an SSIM score of 0.934. Nature Publishing Group UK 2023-12-04 /pmc/articles/PMC10696086/ /pubmed/38049485 http://dx.doi.org/10.1038/s41598-023-47768-4 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Lian, Zuozheng
Wang, Haizhen
An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title_full An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title_fullStr An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title_full_unstemmed An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title_short An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
title_sort image deblurring method using improved u-net model based on multilayer fusion and attention mechanism
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10696086/
https://www.ncbi.nlm.nih.gov/pubmed/38049485
http://dx.doi.org/10.1038/s41598-023-47768-4
work_keys_str_mv AT lianzuozheng animagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism
AT wanghaizhen animagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism
AT lianzuozheng imagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism
AT wanghaizhen imagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism