Cargando…

Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization

The fusion of visual and inertial odometry has matured greatly due to the complementarity of the two sensors. However, the use of high-quality sensors and powerful processors in some applications is difficult due to size and cost limitations, and there are also many challenges in terms of robustness...

Descripción completa

Detalles Bibliográficos
Autores principales: Ma, Shujun, Bai, Xinhui, Wang, Yinglei, Fang, Rui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6749198/
https://www.ncbi.nlm.nih.gov/pubmed/31470677
http://dx.doi.org/10.3390/s19173747
_version_ 1783452221960093696
author Ma, Shujun
Bai, Xinhui
Wang, Yinglei
Fang, Rui
author_facet Ma, Shujun
Bai, Xinhui
Wang, Yinglei
Fang, Rui
author_sort Ma, Shujun
collection PubMed
description The fusion of visual and inertial odometry has matured greatly due to the complementarity of the two sensors. However, the use of high-quality sensors and powerful processors in some applications is difficult due to size and cost limitations, and there are also many challenges in terms of robustness of the algorithm and computational efficiency. In this work, we present VIO-Stereo, a stereo visual-inertial odometry (VIO), which jointly combines the measurements of the stereo cameras and an inexpensive inertial measurement unit (IMU). We use nonlinear optimization to integrate visual measurements with IMU readings in VIO tightly. To decrease the cost of computation, we use the FAST feature detector to improve its efficiency and track features by the KLT sparse optical flow algorithm. We also incorporate accelerometer bias into the measurement model and optimize it together with other variables. Additionally, we perform circular matching between the previous and current stereo image pairs in order to remove outliers in the stereo matching and feature tracking steps, thus reducing the mismatch of feature points and improving the robustness and accuracy of the system. Finally, this work contributes to the experimental comparison of monocular visual-inertial odometry and stereo visual-inertial odometry by evaluating our method using the public EuRoC dataset. Experimental results demonstrate that our method exhibits competitive performance with the most advanced techniques.
format Online
Article
Text
id pubmed-6749198
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-67491982019-09-27 Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization Ma, Shujun Bai, Xinhui Wang, Yinglei Fang, Rui Sensors (Basel) Article The fusion of visual and inertial odometry has matured greatly due to the complementarity of the two sensors. However, the use of high-quality sensors and powerful processors in some applications is difficult due to size and cost limitations, and there are also many challenges in terms of robustness of the algorithm and computational efficiency. In this work, we present VIO-Stereo, a stereo visual-inertial odometry (VIO), which jointly combines the measurements of the stereo cameras and an inexpensive inertial measurement unit (IMU). We use nonlinear optimization to integrate visual measurements with IMU readings in VIO tightly. To decrease the cost of computation, we use the FAST feature detector to improve its efficiency and track features by the KLT sparse optical flow algorithm. We also incorporate accelerometer bias into the measurement model and optimize it together with other variables. Additionally, we perform circular matching between the previous and current stereo image pairs in order to remove outliers in the stereo matching and feature tracking steps, thus reducing the mismatch of feature points and improving the robustness and accuracy of the system. Finally, this work contributes to the experimental comparison of monocular visual-inertial odometry and stereo visual-inertial odometry by evaluating our method using the public EuRoC dataset. Experimental results demonstrate that our method exhibits competitive performance with the most advanced techniques. MDPI 2019-08-29 /pmc/articles/PMC6749198/ /pubmed/31470677 http://dx.doi.org/10.3390/s19173747 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ma, Shujun
Bai, Xinhui
Wang, Yinglei
Fang, Rui
Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title_full Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title_fullStr Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title_full_unstemmed Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title_short Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization
title_sort robust stereo visual-inertial odometry using nonlinear optimization
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6749198/
https://www.ncbi.nlm.nih.gov/pubmed/31470677
http://dx.doi.org/10.3390/s19173747
work_keys_str_mv AT mashujun robuststereovisualinertialodometryusingnonlinearoptimization
AT baixinhui robuststereovisualinertialodometryusingnonlinearoptimization
AT wangyinglei robuststereovisualinertialodometryusingnonlinearoptimization
AT fangrui robuststereovisualinertialodometryusingnonlinearoptimization