Cargando…
Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation
In recent years, image segmentation techniques based on deep learning have achieved many applications in remote sensing, medical, and autonomous driving fields. In space exploration, the segmentation of spacecraft objects by monocular images can support space station on-orbit assembly tasks and spac...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185493/ https://www.ncbi.nlm.nih.gov/pubmed/35684842 http://dx.doi.org/10.3390/s22114222 |
_version_ | 1784724736740163584 |
---|---|
author | Liu, Yuan Zhu, Ming Wang, Jing Guo, Xiangji Yang, Yifan Wang, Jiarong |
author_facet | Liu, Yuan Zhu, Ming Wang, Jing Guo, Xiangji Yang, Yifan Wang, Jiarong |
author_sort | Liu, Yuan |
collection | PubMed |
description | In recent years, image segmentation techniques based on deep learning have achieved many applications in remote sensing, medical, and autonomous driving fields. In space exploration, the segmentation of spacecraft objects by monocular images can support space station on-orbit assembly tasks and space target position and attitude estimation tasks, which has essential research value and broad application prospects. However, there is no segmentation network designed for spacecraft targets. This paper proposes an end-to-end spacecraft image segmentation network using the semantic segmentation network DeepLabv3+ as the basic framework. We develop a multi-scale neural network based on sparse convolution. First, the feature extraction capability is improved by the dilated convolutional network. Second, we introduce the channel attention mechanism into the network to recalibrate the feature responses. Finally, we design a parallel atrous spatial pyramid pooling (ASPP) structure that enhances the contextual information of the network. To verify the effectiveness of the method, we built a spacecraft segmentation dataset on which we conduct experiments on the segmentation algorithm. The experimental results show that the encoder+ attention+ decoder structure proposed in this paper, which focuses on high-level and low-level features, can obtain clear and complete masks of spacecraft targets with high segmentation accuracy. Compared with DeepLabv3+, our method is a significant improvement. We also conduct an ablation study to research the effectiveness of our network framework. |
format | Online Article Text |
id | pubmed-9185493 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-91854932022-06-11 Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation Liu, Yuan Zhu, Ming Wang, Jing Guo, Xiangji Yang, Yifan Wang, Jiarong Sensors (Basel) Article In recent years, image segmentation techniques based on deep learning have achieved many applications in remote sensing, medical, and autonomous driving fields. In space exploration, the segmentation of spacecraft objects by monocular images can support space station on-orbit assembly tasks and space target position and attitude estimation tasks, which has essential research value and broad application prospects. However, there is no segmentation network designed for spacecraft targets. This paper proposes an end-to-end spacecraft image segmentation network using the semantic segmentation network DeepLabv3+ as the basic framework. We develop a multi-scale neural network based on sparse convolution. First, the feature extraction capability is improved by the dilated convolutional network. Second, we introduce the channel attention mechanism into the network to recalibrate the feature responses. Finally, we design a parallel atrous spatial pyramid pooling (ASPP) structure that enhances the contextual information of the network. To verify the effectiveness of the method, we built a spacecraft segmentation dataset on which we conduct experiments on the segmentation algorithm. The experimental results show that the encoder+ attention+ decoder structure proposed in this paper, which focuses on high-level and low-level features, can obtain clear and complete masks of spacecraft targets with high segmentation accuracy. Compared with DeepLabv3+, our method is a significant improvement. We also conduct an ablation study to research the effectiveness of our network framework. MDPI 2022-06-01 /pmc/articles/PMC9185493/ /pubmed/35684842 http://dx.doi.org/10.3390/s22114222 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Liu, Yuan Zhu, Ming Wang, Jing Guo, Xiangji Yang, Yifan Wang, Jiarong Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title | Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title_full | Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title_fullStr | Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title_full_unstemmed | Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title_short | Multi-Scale Deep Neural Network Based on Dilated Convolution for Spacecraft Image Segmentation |
title_sort | multi-scale deep neural network based on dilated convolution for spacecraft image segmentation |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185493/ https://www.ncbi.nlm.nih.gov/pubmed/35684842 http://dx.doi.org/10.3390/s22114222 |
work_keys_str_mv | AT liuyuan multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation AT zhuming multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation AT wangjing multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation AT guoxiangji multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation AT yangyifan multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation AT wangjiarong multiscaledeepneuralnetworkbasedondilatedconvolutionforspacecraftimagesegmentation |