Cargando…

Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency

Semantic segmentation is a growing topic in high-resolution remote sensing image processing. The information in remote sensing images is complex, and the effectiveness of most remote sensing image semantic segmentation methods depends on the number of labels; however, labeling images requires signif...

Descripción completa

Detalles Bibliográficos
Autores principales: Cui, Mengtian, Li, Kai, Li, Yulan, Kamuhanda, Dany, Tessone, Claudio J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10138059/
https://www.ncbi.nlm.nih.gov/pubmed/37190469
http://dx.doi.org/10.3390/e25040681
_version_ 1785032617116041216
author Cui, Mengtian
Li, Kai
Li, Yulan
Kamuhanda, Dany
Tessone, Claudio J.
author_facet Cui, Mengtian
Li, Kai
Li, Yulan
Kamuhanda, Dany
Tessone, Claudio J.
author_sort Cui, Mengtian
collection PubMed
description Semantic segmentation is a growing topic in high-resolution remote sensing image processing. The information in remote sensing images is complex, and the effectiveness of most remote sensing image semantic segmentation methods depends on the number of labels; however, labeling images requires significant time and labor costs. To solve these problems, we propose a semi-supervised semantic segmentation method based on dual cross-entropy consistency and a teacher–student structure. First, we add a channel attention mechanism to the encoding network of the teacher model to reduce the predictive entropy of the pseudo label. Secondly, the two student networks share a common coding network to ensure consistent input information entropy, and a sharpening function is used to reduce the information entropy of unsupervised predictions for both student networks. Finally, we complete the alternate training of the models via two entropy-consistent tasks: (1) semi-supervising student prediction results via pseudo-labels generated from the teacher model, (2) cross-supervision between student models. Experimental results on publicly available datasets indicate that the suggested model can fully understand the hidden information in unlabeled images and reduce the information entropy in prediction, as well as reduce the number of required labeled images with guaranteed accuracy. This allows the new method to outperform the related semi-supervised semantic segmentation algorithm at half the proportion of labeled images.
format Online
Article
Text
id pubmed-10138059
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-101380592023-04-28 Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency Cui, Mengtian Li, Kai Li, Yulan Kamuhanda, Dany Tessone, Claudio J. Entropy (Basel) Article Semantic segmentation is a growing topic in high-resolution remote sensing image processing. The information in remote sensing images is complex, and the effectiveness of most remote sensing image semantic segmentation methods depends on the number of labels; however, labeling images requires significant time and labor costs. To solve these problems, we propose a semi-supervised semantic segmentation method based on dual cross-entropy consistency and a teacher–student structure. First, we add a channel attention mechanism to the encoding network of the teacher model to reduce the predictive entropy of the pseudo label. Secondly, the two student networks share a common coding network to ensure consistent input information entropy, and a sharpening function is used to reduce the information entropy of unsupervised predictions for both student networks. Finally, we complete the alternate training of the models via two entropy-consistent tasks: (1) semi-supervising student prediction results via pseudo-labels generated from the teacher model, (2) cross-supervision between student models. Experimental results on publicly available datasets indicate that the suggested model can fully understand the hidden information in unlabeled images and reduce the information entropy in prediction, as well as reduce the number of required labeled images with guaranteed accuracy. This allows the new method to outperform the related semi-supervised semantic segmentation algorithm at half the proportion of labeled images. MDPI 2023-04-19 /pmc/articles/PMC10138059/ /pubmed/37190469 http://dx.doi.org/10.3390/e25040681 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cui, Mengtian
Li, Kai
Li, Yulan
Kamuhanda, Dany
Tessone, Claudio J.
Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title_full Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title_fullStr Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title_full_unstemmed Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title_short Semi-Supervised Semantic Segmentation of Remote Sensing Images Based on Dual Cross-Entropy Consistency
title_sort semi-supervised semantic segmentation of remote sensing images based on dual cross-entropy consistency
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10138059/
https://www.ncbi.nlm.nih.gov/pubmed/37190469
http://dx.doi.org/10.3390/e25040681
work_keys_str_mv AT cuimengtian semisupervisedsemanticsegmentationofremotesensingimagesbasedondualcrossentropyconsistency
AT likai semisupervisedsemanticsegmentationofremotesensingimagesbasedondualcrossentropyconsistency
AT liyulan semisupervisedsemanticsegmentationofremotesensingimagesbasedondualcrossentropyconsistency
AT kamuhandadany semisupervisedsemanticsegmentationofremotesensingimagesbasedondualcrossentropyconsistency
AT tessoneclaudioj semisupervisedsemanticsegmentationofremotesensingimagesbasedondualcrossentropyconsistency