Cargando…

A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment

Simultaneous localization and mapping (SLAM) plays a crucial role in the field of intelligent mobile robots. However, the traditional Visual SLAM (VSLAM) framework is based on strong assumptions about static environments, which are not applicable to dynamic real-world environments. The correctness o...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Yang, Zhang, Yi, Hu, Lihe, Wang, Wei, Ge, Gengyu, Tan, Shuyi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10611121/
https://www.ncbi.nlm.nih.gov/pubmed/37896538
http://dx.doi.org/10.3390/s23208445
_version_ 1785128417323122688
author Wang, Yang
Zhang, Yi
Hu, Lihe
Wang, Wei
Ge, Gengyu
Tan, Shuyi
author_facet Wang, Yang
Zhang, Yi
Hu, Lihe
Wang, Wei
Ge, Gengyu
Tan, Shuyi
author_sort Wang, Yang
collection PubMed
description Simultaneous localization and mapping (SLAM) plays a crucial role in the field of intelligent mobile robots. However, the traditional Visual SLAM (VSLAM) framework is based on strong assumptions about static environments, which are not applicable to dynamic real-world environments. The correctness of re-localization and recall of loop closure detection are both lower when the mobile robot loses frames in a dynamic environment. Thus, in this paper, the re-localization and loop closure detection method with a semantic topology graph based on ORB-SLAM2 is proposed. First, we use YOLOv5 for object detection and label the recognized dynamic and static objects. Secondly, the topology graph is constructed using the position information of static objects in space. Then, we propose a weight expression for the topology graph to calculate the similarity of topology in different keyframes. Finally, the re-localization and loop closure detection are determined based on the value of topology similarity. Experiments on public datasets show that the semantic topology graph is effective in improving the correct rate of re-localization and the accuracy of loop closure detection in a dynamic environment.
format Online
Article
Text
id pubmed-10611121
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106111212023-10-28 A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment Wang, Yang Zhang, Yi Hu, Lihe Wang, Wei Ge, Gengyu Tan, Shuyi Sensors (Basel) Article Simultaneous localization and mapping (SLAM) plays a crucial role in the field of intelligent mobile robots. However, the traditional Visual SLAM (VSLAM) framework is based on strong assumptions about static environments, which are not applicable to dynamic real-world environments. The correctness of re-localization and recall of loop closure detection are both lower when the mobile robot loses frames in a dynamic environment. Thus, in this paper, the re-localization and loop closure detection method with a semantic topology graph based on ORB-SLAM2 is proposed. First, we use YOLOv5 for object detection and label the recognized dynamic and static objects. Secondly, the topology graph is constructed using the position information of static objects in space. Then, we propose a weight expression for the topology graph to calculate the similarity of topology in different keyframes. Finally, the re-localization and loop closure detection are determined based on the value of topology similarity. Experiments on public datasets show that the semantic topology graph is effective in improving the correct rate of re-localization and the accuracy of loop closure detection in a dynamic environment. MDPI 2023-10-13 /pmc/articles/PMC10611121/ /pubmed/37896538 http://dx.doi.org/10.3390/s23208445 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Yang
Zhang, Yi
Hu, Lihe
Wang, Wei
Ge, Gengyu
Tan, Shuyi
A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title_full A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title_fullStr A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title_full_unstemmed A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title_short A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment
title_sort semantic topology graph to detect re-localization and loop closure of the visual simultaneous localization and mapping system in a dynamic environment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10611121/
https://www.ncbi.nlm.nih.gov/pubmed/37896538
http://dx.doi.org/10.3390/s23208445
work_keys_str_mv AT wangyang asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT zhangyi asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT hulihe asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT wangwei asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT gegengyu asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT tanshuyi asemantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT wangyang semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT zhangyi semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT hulihe semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT wangwei semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT gegengyu semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment
AT tanshuyi semantictopologygraphtodetectrelocalizationandloopclosureofthevisualsimultaneouslocalizationandmappingsysteminadynamicenvironment