Cargando…

Context-aware lightweight remote-sensing image super-resolution network

In recent years, remote-sensing image super-resolution (RSISR) methods based on convolutional neural networks (CNNs) have achieved significant progress. However, the limited receptive field of the convolutional kernel in CNNs hinders the network's ability to effectively capture long-range featu...

Descripción completa

Detalles Bibliográficos
Autores principales: Peng, Guangwen, Xie, Minghong, Fang, Liuyang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10326516/
https://www.ncbi.nlm.nih.gov/pubmed/37425335
http://dx.doi.org/10.3389/fnbot.2023.1220166
_version_ 1785069444221894656
author Peng, Guangwen
Xie, Minghong
Fang, Liuyang
author_facet Peng, Guangwen
Xie, Minghong
Fang, Liuyang
author_sort Peng, Guangwen
collection PubMed
description In recent years, remote-sensing image super-resolution (RSISR) methods based on convolutional neural networks (CNNs) have achieved significant progress. However, the limited receptive field of the convolutional kernel in CNNs hinders the network's ability to effectively capture long-range features in images, thus limiting further improvements in model performance. Additionally, the deployment of existing RSISR models to terminal devices is challenging due to their high computational complexity and large number of parameters. To address these issues, we propose a Context-Aware Lightweight Super-Resolution Network (CALSRN) for remote-sensing images. The proposed network primarily consists of Context-Aware Transformer Blocks (CATBs), which incorporate a Local Context Extraction Branch (LCEB) and a Global Context Extraction Branch (GCEB) to explore both local and global image features. Furthermore, a Dynamic Weight Generation Branch (DWGB) is designed to generate aggregation weights for global and local features, enabling dynamic adjustment of the aggregation process. Specifically, the GCEB employs a Swin Transformer-based structure to obtain global information, while the LCEB utilizes a CNN-based cross-attention mechanism to extract local information. Ultimately, global and local features are aggregated using the weights acquired from the DWGB, capturing the global and local dependencies of the image and enhancing the quality of super-resolution reconstruction. The experimental results demonstrate that the proposed method is capable of reconstructing high-quality images with fewer parameters and less computational complexity compared with existing methods.
format Online
Article
Text
id pubmed-10326516
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-103265162023-07-08 Context-aware lightweight remote-sensing image super-resolution network Peng, Guangwen Xie, Minghong Fang, Liuyang Front Neurorobot Neuroscience In recent years, remote-sensing image super-resolution (RSISR) methods based on convolutional neural networks (CNNs) have achieved significant progress. However, the limited receptive field of the convolutional kernel in CNNs hinders the network's ability to effectively capture long-range features in images, thus limiting further improvements in model performance. Additionally, the deployment of existing RSISR models to terminal devices is challenging due to their high computational complexity and large number of parameters. To address these issues, we propose a Context-Aware Lightweight Super-Resolution Network (CALSRN) for remote-sensing images. The proposed network primarily consists of Context-Aware Transformer Blocks (CATBs), which incorporate a Local Context Extraction Branch (LCEB) and a Global Context Extraction Branch (GCEB) to explore both local and global image features. Furthermore, a Dynamic Weight Generation Branch (DWGB) is designed to generate aggregation weights for global and local features, enabling dynamic adjustment of the aggregation process. Specifically, the GCEB employs a Swin Transformer-based structure to obtain global information, while the LCEB utilizes a CNN-based cross-attention mechanism to extract local information. Ultimately, global and local features are aggregated using the weights acquired from the DWGB, capturing the global and local dependencies of the image and enhancing the quality of super-resolution reconstruction. The experimental results demonstrate that the proposed method is capable of reconstructing high-quality images with fewer parameters and less computational complexity compared with existing methods. Frontiers Media S.A. 2023-06-23 /pmc/articles/PMC10326516/ /pubmed/37425335 http://dx.doi.org/10.3389/fnbot.2023.1220166 Text en Copyright © 2023 Peng, Xie and Fang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Peng, Guangwen
Xie, Minghong
Fang, Liuyang
Context-aware lightweight remote-sensing image super-resolution network
title Context-aware lightweight remote-sensing image super-resolution network
title_full Context-aware lightweight remote-sensing image super-resolution network
title_fullStr Context-aware lightweight remote-sensing image super-resolution network
title_full_unstemmed Context-aware lightweight remote-sensing image super-resolution network
title_short Context-aware lightweight remote-sensing image super-resolution network
title_sort context-aware lightweight remote-sensing image super-resolution network
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10326516/
https://www.ncbi.nlm.nih.gov/pubmed/37425335
http://dx.doi.org/10.3389/fnbot.2023.1220166
work_keys_str_mv AT pengguangwen contextawarelightweightremotesensingimagesuperresolutionnetwork
AT xieminghong contextawarelightweightremotesensingimagesuperresolutionnetwork
AT fangliuyang contextawarelightweightremotesensingimagesuperresolutionnetwork