Cargando…

Edge-Enhanced with Feedback Attention Network for Image Super-Resolution

Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been r...

Descripción completa

Detalles Bibliográficos
Autores principales: Fu, Chunmei, Yin, Yong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999349/
https://www.ncbi.nlm.nih.gov/pubmed/33804241
http://dx.doi.org/10.3390/s21062064
_version_ 1783670762086858752
author Fu, Chunmei
Yin, Yong
author_facet Fu, Chunmei
Yin, Yong
author_sort Fu, Chunmei
collection PubMed
description Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been reasonably applied in the existing deep learning-based SISR methods. Additionally, the results of the existing methods still have serious artifacts and edge blurring. To address these issues, we proposed an Edge-enhanced with Feedback Attention Network for image super-resolution (EFANSR), which comprises three parts. The first part is an SR reconstruction network, which adaptively learns the features of different inputs by integrating channel attention and spatial attention blocks to achieve full utilization of the features. We also introduced feedback mechanism to feed high-level information back to the input and fine-tune the input in the dense spatial and channel attention block. The second part is the edge enhancement network, which obtains a sharp edge through adaptive edge enhancement processing on the output of the first SR network. The final part merges the outputs of the first two parts to obtain the final edge-enhanced SR image. Experimental results show that our method achieves performance comparable to the state-of-the-art methods with lower complexity.
format Online
Article
Text
id pubmed-7999349
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-79993492021-03-28 Edge-Enhanced with Feedback Attention Network for Image Super-Resolution Fu, Chunmei Yin, Yong Sensors (Basel) Article Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been reasonably applied in the existing deep learning-based SISR methods. Additionally, the results of the existing methods still have serious artifacts and edge blurring. To address these issues, we proposed an Edge-enhanced with Feedback Attention Network for image super-resolution (EFANSR), which comprises three parts. The first part is an SR reconstruction network, which adaptively learns the features of different inputs by integrating channel attention and spatial attention blocks to achieve full utilization of the features. We also introduced feedback mechanism to feed high-level information back to the input and fine-tune the input in the dense spatial and channel attention block. The second part is the edge enhancement network, which obtains a sharp edge through adaptive edge enhancement processing on the output of the first SR network. The final part merges the outputs of the first two parts to obtain the final edge-enhanced SR image. Experimental results show that our method achieves performance comparable to the state-of-the-art methods with lower complexity. MDPI 2021-03-15 /pmc/articles/PMC7999349/ /pubmed/33804241 http://dx.doi.org/10.3390/s21062064 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Fu, Chunmei
Yin, Yong
Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title_full Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title_fullStr Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title_full_unstemmed Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title_short Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
title_sort edge-enhanced with feedback attention network for image super-resolution
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999349/
https://www.ncbi.nlm.nih.gov/pubmed/33804241
http://dx.doi.org/10.3390/s21062064
work_keys_str_mv AT fuchunmei edgeenhancedwithfeedbackattentionnetworkforimagesuperresolution
AT yinyong edgeenhancedwithfeedbackattentionnetworkforimagesuperresolution