Cargando…
Edge-Enhanced with Feedback Attention Network for Image Super-Resolution
Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been r...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999349/ https://www.ncbi.nlm.nih.gov/pubmed/33804241 http://dx.doi.org/10.3390/s21062064 |
_version_ | 1783670762086858752 |
---|---|
author | Fu, Chunmei Yin, Yong |
author_facet | Fu, Chunmei Yin, Yong |
author_sort | Fu, Chunmei |
collection | PubMed |
description | Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been reasonably applied in the existing deep learning-based SISR methods. Additionally, the results of the existing methods still have serious artifacts and edge blurring. To address these issues, we proposed an Edge-enhanced with Feedback Attention Network for image super-resolution (EFANSR), which comprises three parts. The first part is an SR reconstruction network, which adaptively learns the features of different inputs by integrating channel attention and spatial attention blocks to achieve full utilization of the features. We also introduced feedback mechanism to feed high-level information back to the input and fine-tune the input in the dense spatial and channel attention block. The second part is the edge enhancement network, which obtains a sharp edge through adaptive edge enhancement processing on the output of the first SR network. The final part merges the outputs of the first two parts to obtain the final edge-enhanced SR image. Experimental results show that our method achieves performance comparable to the state-of-the-art methods with lower complexity. |
format | Online Article Text |
id | pubmed-7999349 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-79993492021-03-28 Edge-Enhanced with Feedback Attention Network for Image Super-Resolution Fu, Chunmei Yin, Yong Sensors (Basel) Article Significant progress has been made in single image super-resolution (SISR) based on deep convolutional neural networks (CNNs). The attention mechanism can capture important features well, and the feedback mechanism can realize the fine-tuning of the output to the input. However, they have not been reasonably applied in the existing deep learning-based SISR methods. Additionally, the results of the existing methods still have serious artifacts and edge blurring. To address these issues, we proposed an Edge-enhanced with Feedback Attention Network for image super-resolution (EFANSR), which comprises three parts. The first part is an SR reconstruction network, which adaptively learns the features of different inputs by integrating channel attention and spatial attention blocks to achieve full utilization of the features. We also introduced feedback mechanism to feed high-level information back to the input and fine-tune the input in the dense spatial and channel attention block. The second part is the edge enhancement network, which obtains a sharp edge through adaptive edge enhancement processing on the output of the first SR network. The final part merges the outputs of the first two parts to obtain the final edge-enhanced SR image. Experimental results show that our method achieves performance comparable to the state-of-the-art methods with lower complexity. MDPI 2021-03-15 /pmc/articles/PMC7999349/ /pubmed/33804241 http://dx.doi.org/10.3390/s21062064 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Fu, Chunmei Yin, Yong Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title | Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title_full | Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title_fullStr | Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title_full_unstemmed | Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title_short | Edge-Enhanced with Feedback Attention Network for Image Super-Resolution |
title_sort | edge-enhanced with feedback attention network for image super-resolution |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7999349/ https://www.ncbi.nlm.nih.gov/pubmed/33804241 http://dx.doi.org/10.3390/s21062064 |
work_keys_str_mv | AT fuchunmei edgeenhancedwithfeedbackattentionnetworkforimagesuperresolution AT yinyong edgeenhancedwithfeedbackattentionnetworkforimagesuperresolution |