Cargando…

Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps

Semantic segmentation of room maps is an essential issue in mobile robots’ execution of tasks. In this work, a new approach to obtain the semantic labels of 2D lidar room maps by combining distance transform watershed-based pre-segmentation and a skillfully designed neural network lidar information...

Descripción completa

Detalles Bibliográficos
Autores principales: Zheng, Tao, Duan, Zhizhao, Wang, Jin, Lu, Guodong, Li, Shengjie, Yu, Zhiyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7919285/
https://www.ncbi.nlm.nih.gov/pubmed/33671979
http://dx.doi.org/10.3390/s21041365
_version_ 1783658107977596928
author Zheng, Tao
Duan, Zhizhao
Wang, Jin
Lu, Guodong
Li, Shengjie
Yu, Zhiyong
author_facet Zheng, Tao
Duan, Zhizhao
Wang, Jin
Lu, Guodong
Li, Shengjie
Yu, Zhiyong
author_sort Zheng, Tao
collection PubMed
description Semantic segmentation of room maps is an essential issue in mobile robots’ execution of tasks. In this work, a new approach to obtain the semantic labels of 2D lidar room maps by combining distance transform watershed-based pre-segmentation and a skillfully designed neural network lidar information sampling classification is proposed. In order to label the room maps with high efficiency, high precision and high speed, we have designed a low-power and high-performance method, which can be deployed on low computing power Raspberry Pi devices. In the training stage, a lidar is simulated to collect the lidar detection line maps of each point in the manually labelled map, and then we use these line maps and the corresponding labels to train the designed neural network. In the testing stage, the new map is first pre-segmented into simple cells with the distance transformation watershed method, then we classify the lidar detection line maps with the trained neural network. The optimized areas of sparse sampling points are proposed by using the result of distance transform generated in the pre-segmentation process to prevent the sampling points selected in the boundary regions from influencing the results of semantic labeling. A prototype mobile robot was developed to verify the proposed method, the feasibility, validity, robustness and high efficiency were verified by a series of tests. The proposed method achieved higher scores in its recall, precision. Specifically, the mean recall is 0.965, and mean precision is 0.943.
format Online
Article
Text
id pubmed-7919285
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-79192852021-03-02 Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps Zheng, Tao Duan, Zhizhao Wang, Jin Lu, Guodong Li, Shengjie Yu, Zhiyong Sensors (Basel) Article Semantic segmentation of room maps is an essential issue in mobile robots’ execution of tasks. In this work, a new approach to obtain the semantic labels of 2D lidar room maps by combining distance transform watershed-based pre-segmentation and a skillfully designed neural network lidar information sampling classification is proposed. In order to label the room maps with high efficiency, high precision and high speed, we have designed a low-power and high-performance method, which can be deployed on low computing power Raspberry Pi devices. In the training stage, a lidar is simulated to collect the lidar detection line maps of each point in the manually labelled map, and then we use these line maps and the corresponding labels to train the designed neural network. In the testing stage, the new map is first pre-segmented into simple cells with the distance transformation watershed method, then we classify the lidar detection line maps with the trained neural network. The optimized areas of sparse sampling points are proposed by using the result of distance transform generated in the pre-segmentation process to prevent the sampling points selected in the boundary regions from influencing the results of semantic labeling. A prototype mobile robot was developed to verify the proposed method, the feasibility, validity, robustness and high efficiency were verified by a series of tests. The proposed method achieved higher scores in its recall, precision. Specifically, the mean recall is 0.965, and mean precision is 0.943. MDPI 2021-02-15 /pmc/articles/PMC7919285/ /pubmed/33671979 http://dx.doi.org/10.3390/s21041365 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zheng, Tao
Duan, Zhizhao
Wang, Jin
Lu, Guodong
Li, Shengjie
Yu, Zhiyong
Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title_full Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title_fullStr Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title_full_unstemmed Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title_short Research on Distance Transform and Neural Network Lidar Information Sampling Classification-Based Semantic Segmentation of 2D Indoor Room Maps
title_sort research on distance transform and neural network lidar information sampling classification-based semantic segmentation of 2d indoor room maps
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7919285/
https://www.ncbi.nlm.nih.gov/pubmed/33671979
http://dx.doi.org/10.3390/s21041365
work_keys_str_mv AT zhengtao researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps
AT duanzhizhao researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps
AT wangjin researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps
AT luguodong researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps
AT lishengjie researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps
AT yuzhiyong researchondistancetransformandneuralnetworklidarinformationsamplingclassificationbasedsemanticsegmentationof2dindoorroommaps