Cargando…
MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images
One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838741/ https://www.ncbi.nlm.nih.gov/pubmed/35161634 http://dx.doi.org/10.3390/s22030888 |
_version_ | 1784650200338399232 |
---|---|
author | Ma, Jinming Shi, Gang Li, Yanxiang Zhao, Ziyu |
author_facet | Ma, Jinming Shi, Gang Li, Yanxiang Zhao, Ziyu |
author_sort | Ma, Jinming |
collection | PubMed |
description | One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been designed. The network enhances feature extraction and feature fusion by building different blocks. First, a Feature Enhancement Module (FEM) is proposed. The FEM introduces Coordinate Attention (CA). The CA block embeds the position information into the channel attention to obtain the accurate position information and channel relationships of the remote sensing images. An updated feature map is obtained by using an element-wise summation of the input of the FEM and the output of the CA. The FEM enhances the feature representation in the network. Then, an attention-based Feature Fusion Module (FFM) is designed. It changes the previous idea of layer-by-layer fusion and chooses cross-layer aggregation. The FFM is to compensate for some semantic information missing as the number of layers increases. FFM plays an important role in the communication of feature maps at different scales. To further refine the feature representation, a Refinement Residual Block (RRB) is proposed. The RRB changes the number of channels of the aggregated features and uses convolutional blocks to further refine the feature representation. Compared with all compared methods, MAFF-Net improves the F1-Score scores by 4.9%, 3.2%, and 1.7% on three publicly available benchmark datasets, the CDD, LEVIR-CD, and WHU-CD datasets, respectively. The experimental results show that MAFF-Net achieves state-of-the-art (SOTA) CD performance on these three challenging datasets. |
format | Online Article Text |
id | pubmed-8838741 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-88387412022-02-13 MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images Ma, Jinming Shi, Gang Li, Yanxiang Zhao, Ziyu Sensors (Basel) Article One of the most important tasks in remote sensing image analysis is remote sensing image Change Detection (CD), and CD is the key to helping people obtain more accurate information about changes on the Earth’s surface. A Multi-Attention Guided Feature Fusion Network (MAFF-Net) for CD tasks has been designed. The network enhances feature extraction and feature fusion by building different blocks. First, a Feature Enhancement Module (FEM) is proposed. The FEM introduces Coordinate Attention (CA). The CA block embeds the position information into the channel attention to obtain the accurate position information and channel relationships of the remote sensing images. An updated feature map is obtained by using an element-wise summation of the input of the FEM and the output of the CA. The FEM enhances the feature representation in the network. Then, an attention-based Feature Fusion Module (FFM) is designed. It changes the previous idea of layer-by-layer fusion and chooses cross-layer aggregation. The FFM is to compensate for some semantic information missing as the number of layers increases. FFM plays an important role in the communication of feature maps at different scales. To further refine the feature representation, a Refinement Residual Block (RRB) is proposed. The RRB changes the number of channels of the aggregated features and uses convolutional blocks to further refine the feature representation. Compared with all compared methods, MAFF-Net improves the F1-Score scores by 4.9%, 3.2%, and 1.7% on three publicly available benchmark datasets, the CDD, LEVIR-CD, and WHU-CD datasets, respectively. The experimental results show that MAFF-Net achieves state-of-the-art (SOTA) CD performance on these three challenging datasets. MDPI 2022-01-24 /pmc/articles/PMC8838741/ /pubmed/35161634 http://dx.doi.org/10.3390/s22030888 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ma, Jinming Shi, Gang Li, Yanxiang Zhao, Ziyu MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title | MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title_full | MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title_fullStr | MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title_full_unstemmed | MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title_short | MAFF-Net: Multi-Attention Guided Feature Fusion Network for Change Detection in Remote Sensing Images |
title_sort | maff-net: multi-attention guided feature fusion network for change detection in remote sensing images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8838741/ https://www.ncbi.nlm.nih.gov/pubmed/35161634 http://dx.doi.org/10.3390/s22030888 |
work_keys_str_mv | AT majinming maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages AT shigang maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages AT liyanxiang maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages AT zhaoziyu maffnetmultiattentionguidedfeaturefusionnetworkforchangedetectioninremotesensingimages |