Cargando…

RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment

For a SLAM system operating in a dynamic indoor environment, its position estimation accuracy and visual odometer stability could be reduced because the system can be easily affected by moving obstacles. In this paper, a visual SLAM algorithm based on the Yolov4-Tiny network is proposed. Meanwhile,...

Descripción completa

Detalles Bibliográficos
Autores principales: Chang, Zhanyuan, Wu, Honglin, Sun, Yunlong, Li, Chuanjiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8879659/
https://www.ncbi.nlm.nih.gov/pubmed/35208354
http://dx.doi.org/10.3390/mi13020230
_version_ 1784658945216872448
author Chang, Zhanyuan
Wu, Honglin
Sun, Yunlong
Li, Chuanjiang
author_facet Chang, Zhanyuan
Wu, Honglin
Sun, Yunlong
Li, Chuanjiang
author_sort Chang, Zhanyuan
collection PubMed
description For a SLAM system operating in a dynamic indoor environment, its position estimation accuracy and visual odometer stability could be reduced because the system can be easily affected by moving obstacles. In this paper, a visual SLAM algorithm based on the Yolov4-Tiny network is proposed. Meanwhile, a dynamic feature point elimination strategy based on the traditional ORBSLAM is proposed. Besides this, to obtain semantic information, object detection is carried out when the feature points of the image are extracted. In addition, the epipolar geometry algorithm and the LK optical flow method are employed to detect dynamic objects. The dynamic feature points are removed in the tracking thread, and only the static feature points are used to estimate the position of the camera. The proposed method is evaluated on the TUM dataset. The experimental results show that, compared with ORB-SLAM2, our algorithm improves the camera position estimation accuracy by 93.35% in a highly dynamic environment. Additionally, the average time needed by our algorithm to process an image frame in the tracking thread is 21.49 ms, achieving real-time performance.
format Online
Article
Text
id pubmed-8879659
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-88796592022-02-26 RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment Chang, Zhanyuan Wu, Honglin Sun, Yunlong Li, Chuanjiang Micromachines (Basel) Article For a SLAM system operating in a dynamic indoor environment, its position estimation accuracy and visual odometer stability could be reduced because the system can be easily affected by moving obstacles. In this paper, a visual SLAM algorithm based on the Yolov4-Tiny network is proposed. Meanwhile, a dynamic feature point elimination strategy based on the traditional ORBSLAM is proposed. Besides this, to obtain semantic information, object detection is carried out when the feature points of the image are extracted. In addition, the epipolar geometry algorithm and the LK optical flow method are employed to detect dynamic objects. The dynamic feature points are removed in the tracking thread, and only the static feature points are used to estimate the position of the camera. The proposed method is evaluated on the TUM dataset. The experimental results show that, compared with ORB-SLAM2, our algorithm improves the camera position estimation accuracy by 93.35% in a highly dynamic environment. Additionally, the average time needed by our algorithm to process an image frame in the tracking thread is 21.49 ms, achieving real-time performance. MDPI 2022-01-30 /pmc/articles/PMC8879659/ /pubmed/35208354 http://dx.doi.org/10.3390/mi13020230 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chang, Zhanyuan
Wu, Honglin
Sun, Yunlong
Li, Chuanjiang
RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title_full RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title_fullStr RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title_full_unstemmed RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title_short RGB-D Visual SLAM Based on Yolov4-Tiny in Indoor Dynamic Environment
title_sort rgb-d visual slam based on yolov4-tiny in indoor dynamic environment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8879659/
https://www.ncbi.nlm.nih.gov/pubmed/35208354
http://dx.doi.org/10.3390/mi13020230
work_keys_str_mv AT changzhanyuan rgbdvisualslambasedonyolov4tinyinindoordynamicenvironment
AT wuhonglin rgbdvisualslambasedonyolov4tinyinindoordynamicenvironment
AT sunyunlong rgbdvisualslambasedonyolov4tinyinindoordynamicenvironment
AT lichuanjiang rgbdvisualslambasedonyolov4tinyinindoordynamicenvironment