Cargando…

MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images

One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been...

Descripción completa

Detalles Bibliográficos
Autores principales: Ma, Jinming, Shi, Gang, Li, Yanxiang, Zhao, Ziyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838741/
https://www.ncbi.nlm.nih.gov/pubmed/35161634
http://dx.doi.org/10.3390/s22030888
_version_ 1784650200338399232
author Ma, Jinming
Shi, Gang
Li, Yanxiang
Zhao, Ziyu
author_facet Ma, Jinming
Shi, Gang
Li, Yanxiang
Zhao, Ziyu
author_sort Ma, Jinming
collection PubMed
description One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been designed. The network enhances feature extraction and feature fusion by building different blocks. First, a Feature Enhancement Module (FEM) is proposed. The FEM introduces Coordinate Attention (CA). The CA block embeds the position information into the channel attention to obtain the accurate position information and channel relationships of the remote sensing images. An updated feature map is obtained by using an element-wise summation of the input of the FEM and the output of the CA. The FEM enhances the feature representation in the network. Then, an attention-based Feature Fusion Module (FFM) is designed. It changes the previous idea of layer-by-layer fusion and chooses cross-layer aggregation. The FFM is to compensate for some semantic information missing as the number of layers increases. FFM plays an important role in the communication of feature maps at different scales. To further refine the feature representation, a Refinement Residual Block (RRB) is proposed. The RRB changes the number of channels of the aggregated features and uses convolutional blocks to further refine the feature representation. Compared with all compared methods, MAFF-Net improves the F1-Score scores by 4.9%, 3.2%, and 1.7% on three publicly available benchmark datasets, the CDD, LEVIR-CD, and WHU-CD datasets, respectively. The experimental results show that MAFF-Net achieves state-of-the-art (SOTA) CD performance on these three challenging datasets.
format Online
Article
Text
id pubmed-8838741
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88387412022-02-13 MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images Ma, Jinming Shi, Gang Li, Yanxiang Zhao, Ziyu Sensors (Basel) Article One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been designed. The network enhances feature extraction and feature fusion by building different blocks. First, a Feature Enhancement Module (FEM) is proposed. The FEM introduces Coordinate Attention (CA). The CA block embeds the position information into the channel attention to obtain the accurate position information and channel relationships of the remote sensing images. An updated feature map is obtained by using an element-wise summation of the input of the FEM and the output of the CA. The FEM enhances the feature representation in the network. Then, an attention-based Feature Fusion Module (FFM) is designed. It changes the previous idea of layer-by-layer fusion and chooses cross-layer aggregation. The FFM is to compensate for some semantic information missing as the number of layers increases. FFM plays an important role in the communication of feature maps at different scales. To further refine the feature representation, a Refinement Residual Block (RRB) is proposed. The RRB changes the number of channels of the aggregated features and uses convolutional blocks to further refine the feature representation. Compared with all compared methods, MAFF-Net improves the F1-Score scores by 4.9%, 3.2%, and 1.7% on three publicly available benchmark datasets, the CDD, LEVIR-CD, and WHU-CD datasets, respectively. The experimental results show that MAFF-Net achieves state-of-the-art (SOTA) CD performance on these three challenging datasets. MDPI 2022-01-24 /pmc/articles/PMC8838741/ /pubmed/35161634 http://dx.doi.org/10.3390/s22030888 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ma, Jinming
Shi, Gang
Li, Yanxiang
Zhao, Ziyu
MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title_full MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title_fullStr MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title_full_unstemmed MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title_short MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
title_sort maff-net: multi-attention guided feature fusion network for change detection in remote sensing images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838741/
https://www.ncbi.nlm.nih.gov/pubmed/35161634
http://dx.doi.org/10.3390/s22030888
work_keys_str_mv AT majinming maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages
AT shigang maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages
AT liyanxiang maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages
AT zhaoziyu maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages