Cargando…
Multi-scale feature progressive fusion network for remote sensing image change detection
Presently, research on deep learning-based change detection (CD) methods has become a hot topic. In particular, feature pyramid networks (FPNs) are widely used in CD tasks to gradually fuse semantic features. However, existing FPN-based CD methods do not correctly detect the complete change region a...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9279334/ https://www.ncbi.nlm.nih.gov/pubmed/35831628 http://dx.doi.org/10.1038/s41598-022-16329-6 |
_version_ | 1784746374796935168 |
---|---|
author | Lu, Di Cheng, Shuli Wang, Liejun Song, Shiji |
author_facet | Lu, Di Cheng, Shuli Wang, Liejun Song, Shiji |
author_sort | Lu, Di |
collection | PubMed |
description | Presently, research on deep learning-based change detection (CD) methods has become a hot topic. In particular, feature pyramid networks (FPNs) are widely used in CD tasks to gradually fuse semantic features. However, existing FPN-based CD methods do not correctly detect the complete change region and cannot accurately locate the boundaries of the change region. To solve these problems, a new Multi-Scale Feature Progressive Fusion Network (MFPF-Net) is proposed, which consists of three innovative modules: Layer Feature Fusion Module (LFFM), Multi-Scale Feature Aggregation Module (MSFA), and Multi-Scale Feature Distribution Module (MSFD). Specifically, we first concatenate the features of each layer extracted from the bi-temporal images with their difference maps, and the resulting change maps fuse richer semantic information while effectively representing change regions. Then, the obtained change maps of each layer are directly aggregated, which improves the effective communication and full fusion of feature maps in CD while avoiding the interference of indirect information. Finally, the aggregated feature maps are layered again by pooling and convolution operations, and then a feature fusion strategy with a pyramid structure is used, with layers fused from low to high, to obtain richer contextual information, so that each layer of the layered feature maps has original semantic information and semantic features of other layers. We conducted comprehensive experiments on three publicly available benchmark datasets, CDD, LEVIR-CD, and WHU-CD to verify the effectiveness of the method, and the experimental results show that the method in this paper outperforms other comparative methods. |
format | Online Article Text |
id | pubmed-9279334 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-92793342022-07-15 Multi-scale feature progressive fusion network for remote sensing image change detection Lu, Di Cheng, Shuli Wang, Liejun Song, Shiji Sci Rep Article Presently, research on deep learning-based change detection (CD) methods has become a hot topic. In particular, feature pyramid networks (FPNs) are widely used in CD tasks to gradually fuse semantic features. However, existing FPN-based CD methods do not correctly detect the complete change region and cannot accurately locate the boundaries of the change region. To solve these problems, a new Multi-Scale Feature Progressive Fusion Network (MFPF-Net) is proposed, which consists of three innovative modules: Layer Feature Fusion Module (LFFM), Multi-Scale Feature Aggregation Module (MSFA), and Multi-Scale Feature Distribution Module (MSFD). Specifically, we first concatenate the features of each layer extracted from the bi-temporal images with their difference maps, and the resulting change maps fuse richer semantic information while effectively representing change regions. Then, the obtained change maps of each layer are directly aggregated, which improves the effective communication and full fusion of feature maps in CD while avoiding the interference of indirect information. Finally, the aggregated feature maps are layered again by pooling and convolution operations, and then a feature fusion strategy with a pyramid structure is used, with layers fused from low to high, to obtain richer contextual information, so that each layer of the layered feature maps has original semantic information and semantic features of other layers. We conducted comprehensive experiments on three publicly available benchmark datasets, CDD, LEVIR-CD, and WHU-CD to verify the effectiveness of the method, and the experimental results show that the method in this paper outperforms other comparative methods. Nature Publishing Group UK 2022-07-13 /pmc/articles/PMC9279334/ /pubmed/35831628 http://dx.doi.org/10.1038/s41598-022-16329-6 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Lu, Di Cheng, Shuli Wang, Liejun Song, Shiji Multi-scale feature progressive fusion network for remote sensing image change detection |
title | Multi-scale feature progressive fusion network for remote sensing image change detection |
title_full | Multi-scale feature progressive fusion network for remote sensing image change detection |
title_fullStr | Multi-scale feature progressive fusion network for remote sensing image change detection |
title_full_unstemmed | Multi-scale feature progressive fusion network for remote sensing image change detection |
title_short | Multi-scale feature progressive fusion network for remote sensing image change detection |
title_sort | multi-scale feature progressive fusion network for remote sensing image change detection |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9279334/ https://www.ncbi.nlm.nih.gov/pubmed/35831628 http://dx.doi.org/10.1038/s41598-022-16329-6 |
work_keys_str_mv | AT ludi multiscalefeatureprogressivefusionnetworkforremotesensingimagechangedetection AT chengshuli multiscalefeatureprogressivefusionnetworkforremotesensingimagechangedetection AT wangliejun multiscalefeatureprogressivefusionnetworkforremotesensingimagechangedetection AT songshiji multiscalefeatureprogressivefusionnetworkforremotesensingimagechangedetection |