Cargando…

Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment

Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have bet...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhu, Baoyu, Lv, Qunbo, Yang, Yuanbo, Sui, Xuefu, Zhang, Yu, Tang, Yinhui, Tan, Zheng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9611111/
https://www.ncbi.nlm.nih.gov/pubmed/36298241
http://dx.doi.org/10.3390/s22207894
_version_ 1784819445359706112
author Zhu, Baoyu
Lv, Qunbo
Yang, Yuanbo
Sui, Xuefu
Zhang, Yu
Tang, Yinhui
Tan, Zheng
author_facet Zhu, Baoyu
Lv, Qunbo
Yang, Yuanbo
Sui, Xuefu
Zhang, Yu
Tang, Yinhui
Tan, Zheng
author_sort Zhu, Baoyu
collection PubMed
description Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have better generalizability. However, the existing deep learning algorithms usually suffer from feature misalignment, resulting in a high probability of missing details or errors in the recovered images. This paper proposes an end-to-end generative adversarial network (SDD-GAN) for single-image motion deblurring to address this problem and to optimize the recovery of blurred remote sensing images. Firstly, this paper applies a feature alignment module (FAFM) in the generator to learn the offset between feature maps to adjust the position of each sample in the convolution kernel and to align the feature maps according to the context; secondly, a feature importance selection module is introduced in the generator to adaptively filter the feature maps in the spatial and channel domains, preserving reliable details in the feature maps and improving the performance of the algorithm. In addition, this paper constructs a self-constructed remote sensing dataset (RSDATA) based on the mechanism of image blurring caused by the high-speed orbital motion of satellites. Comparative experiments are conducted on self-built remote sensing datasets and public datasets as well as on real remote sensing blurred images taken by an in-orbit satellite (CX-6(02)). The results show that the algorithm in this paper outperforms the comparison algorithm in terms of both quantitative evaluation and visual effects.
format Online
Article
Text
id pubmed-9611111
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96111112022-10-28 Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment Zhu, Baoyu Lv, Qunbo Yang, Yuanbo Sui, Xuefu Zhang, Yu Tang, Yinhui Tan, Zheng Sensors (Basel) Article Motion blur recovery is a common method in the field of remote sensing image processing that can effectively improve the accuracy of detection and recognition. Among the existing motion blur recovery methods, the algorithms based on deep learning do not rely on a priori knowledge and, thus, have better generalizability. However, the existing deep learning algorithms usually suffer from feature misalignment, resulting in a high probability of missing details or errors in the recovered images. This paper proposes an end-to-end generative adversarial network (SDD-GAN) for single-image motion deblurring to address this problem and to optimize the recovery of blurred remote sensing images. Firstly, this paper applies a feature alignment module (FAFM) in the generator to learn the offset between feature maps to adjust the position of each sample in the convolution kernel and to align the feature maps according to the context; secondly, a feature importance selection module is introduced in the generator to adaptively filter the feature maps in the spatial and channel domains, preserving reliable details in the feature maps and improving the performance of the algorithm. In addition, this paper constructs a self-constructed remote sensing dataset (RSDATA) based on the mechanism of image blurring caused by the high-speed orbital motion of satellites. Comparative experiments are conducted on self-built remote sensing datasets and public datasets as well as on real remote sensing blurred images taken by an in-orbit satellite (CX-6(02)). The results show that the algorithm in this paper outperforms the comparison algorithm in terms of both quantitative evaluation and visual effects. MDPI 2022-10-17 /pmc/articles/PMC9611111/ /pubmed/36298241 http://dx.doi.org/10.3390/s22207894 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhu, Baoyu
Lv, Qunbo
Yang, Yuanbo
Sui, Xuefu
Zhang, Yu
Tang, Yinhui
Tan, Zheng
Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title_full Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title_fullStr Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title_full_unstemmed Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title_short Blind Deblurring of Remote-Sensing Single Images Based on Feature Alignment
title_sort blind deblurring of remote-sensing single images based on feature alignment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9611111/
https://www.ncbi.nlm.nih.gov/pubmed/36298241
http://dx.doi.org/10.3390/s22207894
work_keys_str_mv AT zhubaoyu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT lvqunbo blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT yangyuanbo blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT suixuefu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT zhangyu blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT tangyinhui blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment
AT tanzheng blinddeblurringofremotesensingsingleimagesbasedonfeaturealignment