Cargando…
Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have bet...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9611111/ https://www.ncbi.nlm.nih.gov/pubmed/36298241 http://dx.doi.org/10.3390/s22207894 |
_version_ | 1784819445359706112 |
---|---|
author | Zhu, Baoyu Lv, Qunbo Yang, Yuanbo Sui, Xuefu Zhang, Yu Tang, Yinhui Tan, Zheng |
author_facet | Zhu, Baoyu Lv, Qunbo Yang, Yuanbo Sui, Xuefu Zhang, Yu Tang, Yinhui Tan, Zheng |
author_sort | Zhu, Baoyu |
collection | PubMed |
description | Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have better generalizability. However, the existing deep learning algorithms usually suffer from feature misalignment, resulting in a high probability of missing details or errors in the recovered images. This paper proposes an end-to-end generative adversarial network (SDD-GAN) for single-image motion deblurring to address this problem and to optimize the recovery of blurred remote sensing images. Firstly, this paper applies a feature alignment module (FAFM) in the generator to learn the offset between feature maps to adjust the position of each sample in the convolution kernel and to align the feature maps according to the context; secondly, a feature importance selection module is introduced in the generator to adaptively filter the feature maps in the spatial and channel domains, preserving reliable details in the feature maps and improving the performance of the algorithm. In addition, this paper constructs a self-constructed remote sensing dataset (RSDATA) based on the mechanism of image blurring caused by the high-speed orbital motion of satellites. Comparative experiments are conducted on self-built remote sensing datasets and public datasets as well as on real remote sensing blurred images taken by an in-orbit satellite (CX-6(02)). The results show that the algorithm in this paper outperforms the comparison algorithm in terms of both quantitative evaluation and visual effects. |
format | Online Article Text |
id | pubmed-9611111 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-96111112022-10-28 Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment Zhu, Baoyu Lv, Qunbo Yang, Yuanbo Sui, Xuefu Zhang, Yu Tang, Yinhui Tan, Zheng Sensors (Basel) Article Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have better generalizability. However, the existing deep learning algorithms usually suffer from feature misalignment, resulting in a high probability of missing details or errors in the recovered images. This paper proposes an end-to-end generative adversarial network (SDD-GAN) for single-image motion deblurring to address this problem and to optimize the recovery of blurred remote sensing images. Firstly, this paper applies a feature alignment module (FAFM) in the generator to learn the offset between feature maps to adjust the position of each sample in the convolution kernel and to align the feature maps according to the context; secondly, a feature importance selection module is introduced in the generator to adaptively filter the feature maps in the spatial and channel domains, preserving reliable details in the feature maps and improving the performance of the algorithm. In addition, this paper constructs a self-constructed remote sensing dataset (RSDATA) based on the mechanism of image blurring caused by the high-speed orbital motion of satellites. Comparative experiments are conducted on self-built remote sensing datasets and public datasets as well as on real remote sensing blurred images taken by an in-orbit satellite (CX-6(02)). The results show that the algorithm in this paper outperforms the comparison algorithm in terms of both quantitative evaluation and visual effects. MDPI 2022-10-17 /pmc/articles/PMC9611111/ /pubmed/36298241 http://dx.doi.org/10.3390/s22207894 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhu, Baoyu Lv, Qunbo Yang, Yuanbo Sui, Xuefu Zhang, Yu Tang, Yinhui Tan, Zheng Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title | Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title_full | Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title_fullStr | Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title_full_unstemmed | Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title_short | Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment |
title_sort | blind deblurring of remote-sensing single images based on feature alignment |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9611111/ https://www.ncbi.nlm.nih.gov/pubmed/36298241 http://dx.doi.org/10.3390/s22207894 |
work_keys_str_mv | AT zhubaoyu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT lvqunbo blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT yangyuanbo blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT suixuefu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT zhangyu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT tangyinhui blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment AT tanzheng blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment |