Cargando…
An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism
The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections a...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10696086/ https://www.ncbi.nlm.nih.gov/pubmed/38049485 http://dx.doi.org/10.1038/s41598-023-47768-4 |
_version_ | 1785154498349498368 |
---|---|
author | Lian, Zuozheng Wang, Haizhen |
author_facet | Lian, Zuozheng Wang, Haizhen |
author_sort | Lian, Zuozheng |
collection | PubMed |
description | The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections across various hierarchical levels, resulting in inadequate receptive fields and suboptimal deblurring outcomes. In U-Net, a more adaptable approach is employed, integrating diverse levels of features effectively. Such design not only significantly reduces the number of parameters but also maintains an acceptable accuracy range. Based on such advantages, an improved U-Net model for enhancing the image deblurring effect was proposed in the present study. Firstly, the model structure was designed, incorporating two key components: the MLFF (multilayer feature fusion) module and the DMRFAB (dense multi-receptive field attention block). The aim of these modules is to improve the feature extraction ability. The MLFF module facilitates the integration of feature information across various layers, while the DMRFAB module, enriched with an attention mechanism, extracts crucial and intricate image details, thereby enhancing the overall information extraction process. Finally, in combination with fast Fourier transform, the FRLF (Frequency Reconstruction Loss Function) was proposed. The FRLF obtains the frequency value of the image by reducing the frequency difference. The present experiment results reveal that the proposed method exhibited higher-quality visual effects. Specifically, for the GoPro dataset, the PSNR (peak signal-to-noise ratio) reached 31.53, while the SSIM (structural similarity index) attained a value of 0.948. Additionally, for the Real Blur dataset, the PSNR achieved 31.32, accompanied by an SSIM score of 0.934. |
format | Online Article Text |
id | pubmed-10696086 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-106960862023-12-06 An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism Lian, Zuozheng Wang, Haizhen Sci Rep Article The investigation of image deblurring techniques in dynamic scenes represents a prominent area of research. Recently, deep learning technology has gained extensive traction within the field of image deblurring methodologies. However, such methods often suffer from limited inherent interconnections across various hierarchical levels, resulting in inadequate receptive fields and suboptimal deblurring outcomes. In U-Net, a more adaptable approach is employed, integrating diverse levels of features effectively. Such design not only significantly reduces the number of parameters but also maintains an acceptable accuracy range. Based on such advantages, an improved U-Net model for enhancing the image deblurring effect was proposed in the present study. Firstly, the model structure was designed, incorporating two key components: the MLFF (multilayer feature fusion) module and the DMRFAB (dense multi-receptive field attention block). The aim of these modules is to improve the feature extraction ability. The MLFF module facilitates the integration of feature information across various layers, while the DMRFAB module, enriched with an attention mechanism, extracts crucial and intricate image details, thereby enhancing the overall information extraction process. Finally, in combination with fast Fourier transform, the FRLF (Frequency Reconstruction Loss Function) was proposed. The FRLF obtains the frequency value of the image by reducing the frequency difference. The present experiment results reveal that the proposed method exhibited higher-quality visual effects. Specifically, for the GoPro dataset, the PSNR (peak signal-to-noise ratio) reached 31.53, while the SSIM (structural similarity index) attained a value of 0.948. Additionally, for the Real Blur dataset, the PSNR achieved 31.32, accompanied by an SSIM score of 0.934. Nature Publishing Group UK 2023-12-04 /pmc/articles/PMC10696086/ /pubmed/38049485 http://dx.doi.org/10.1038/s41598-023-47768-4 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Lian, Zuozheng Wang, Haizhen An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title | An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title_full | An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title_fullStr | An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title_full_unstemmed | An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title_short | An image deblurring method using improved U-Net model based on multilayer fusion and attention mechanism |
title_sort | image deblurring method using improved u-net model based on multilayer fusion and attention mechanism |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10696086/ https://www.ncbi.nlm.nih.gov/pubmed/38049485 http://dx.doi.org/10.1038/s41598-023-47768-4 |
work_keys_str_mv | AT lianzuozheng animagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism AT wanghaizhen animagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism AT lianzuozheng imagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism AT wanghaizhen imagedeblurringmethodusingimprovedunetmodelbasedonmultilayerfusionandattentionmechanism |