Cargando…

Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model

The great success of deep learning in the field of computer vision provides a development opportunity for intelligent information extraction of remote sensing images. In the field of agriculture, a large number of deep convolutional neural networks have been applied to crop spatial distribution reco...

Descripción completa

Detalles Bibliográficos
Autores principales: Lu, Tingyu, Gao, Meixiang, Wang, Lei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10428625/
https://www.ncbi.nlm.nih.gov/pubmed/37593043
http://dx.doi.org/10.3389/fpls.2023.1196634
_version_ 1785090515290554368
author Lu, Tingyu
Gao, Meixiang
Wang, Lei
author_facet Lu, Tingyu
Gao, Meixiang
Wang, Lei
author_sort Lu, Tingyu
collection PubMed
description The great success of deep learning in the field of computer vision provides a development opportunity for intelligent information extraction of remote sensing images. In the field of agriculture, a large number of deep convolutional neural networks have been applied to crop spatial distribution recognition. In this paper, crop mapping is defined as a semantic segmentation problem, and a multi-scale feature fusion semantic segmentation model MSSNet is proposed for crop recognition, aiming at the key problem that multi-scale neural networks can learn multiple features under different sensitivity fields to improve classification accuracy and fine-grained image classification. Firstly, the network uses multi-branch asymmetric convolution and dilated convolution. Each branch concatenates conventional convolution with convolution nuclei of different sizes with dilated convolution with different expansion coefficients. Then, the features extracted from each branch are spliced to achieve multi-scale feature fusion. Finally, a skip connection is used to combine low-level features from the shallow network with abstract features from the deep network to further enrich the semantic information. In the experiment of crop classification using Sentinel-2 remote sensing image, it was found that the method made full use of spectral and spatial characteristics of crop, achieved good recognition effect. The output crop classification mapping was better in plot segmentation and edge characterization of ground objects. This study can provide a good reference for high-precision crop mapping and field plot extraction, and at the same time, avoid excessive data acquisition and processing.
format Online
Article
Text
id pubmed-10428625
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-104286252023-08-17 Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model Lu, Tingyu Gao, Meixiang Wang, Lei Front Plant Sci Plant Science The great success of deep learning in the field of computer vision provides a development opportunity for intelligent information extraction of remote sensing images. In the field of agriculture, a large number of deep convolutional neural networks have been applied to crop spatial distribution recognition. In this paper, crop mapping is defined as a semantic segmentation problem, and a multi-scale feature fusion semantic segmentation model MSSNet is proposed for crop recognition, aiming at the key problem that multi-scale neural networks can learn multiple features under different sensitivity fields to improve classification accuracy and fine-grained image classification. Firstly, the network uses multi-branch asymmetric convolution and dilated convolution. Each branch concatenates conventional convolution with convolution nuclei of different sizes with dilated convolution with different expansion coefficients. Then, the features extracted from each branch are spliced to achieve multi-scale feature fusion. Finally, a skip connection is used to combine low-level features from the shallow network with abstract features from the deep network to further enrich the semantic information. In the experiment of crop classification using Sentinel-2 remote sensing image, it was found that the method made full use of spectral and spatial characteristics of crop, achieved good recognition effect. The output crop classification mapping was better in plot segmentation and edge characterization of ground objects. This study can provide a good reference for high-precision crop mapping and field plot extraction, and at the same time, avoid excessive data acquisition and processing. Frontiers Media S.A. 2023-08-01 /pmc/articles/PMC10428625/ /pubmed/37593043 http://dx.doi.org/10.3389/fpls.2023.1196634 Text en Copyright © 2023 Lu, Gao and Wang https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Plant Science
Lu, Tingyu
Gao, Meixiang
Wang, Lei
Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title_full Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title_fullStr Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title_full_unstemmed Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title_short Crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
title_sort crop classification in high-resolution remote sensing images based on multi-scale feature fusion semantic segmentation model
topic Plant Science
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10428625/
https://www.ncbi.nlm.nih.gov/pubmed/37593043
http://dx.doi.org/10.3389/fpls.2023.1196634
work_keys_str_mv AT lutingyu cropclassificationinhighresolutionremotesensingimagesbasedonmultiscalefeaturefusionsemanticsegmentationmodel
AT gaomeixiang cropclassificationinhighresolutionremotesensingimagesbasedonmultiscalefeaturefusionsemanticsegmentationmodel
AT wanglei cropclassificationinhighresolutionremotesensingimagesbasedonmultiscalefeaturefusionsemanticsegmentationmodel