Cargando…

Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences

Estimating camera pose is one of the key steps in computer vison, photogrammetry and SLAM (Simultaneous Localization and Mapping). It is mainly calculated based on the 2D–3D correspondences of features, including 2D–3D point and line correspondences. If a zoom lens is equipped, the focal length need...

Descripción completa

Detalles Bibliográficos
Autores principales: Guo, Kai, Zhang, Zhixiang, Zhang, Zhongsen, Tian, Ye, Chen, Honglin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9657983/
https://www.ncbi.nlm.nih.gov/pubmed/36365950
http://dx.doi.org/10.3390/s22218253
_version_ 1784829838090043392
author Guo, Kai
Zhang, Zhixiang
Zhang, Zhongsen
Tian, Ye
Chen, Honglin
author_facet Guo, Kai
Zhang, Zhixiang
Zhang, Zhongsen
Tian, Ye
Chen, Honglin
author_sort Guo, Kai
collection PubMed
description Estimating camera pose is one of the key steps in computer vison, photogrammetry and SLAM (Simultaneous Localization and Mapping). It is mainly calculated based on the 2D–3D correspondences of features, including 2D–3D point and line correspondences. If a zoom lens is equipped, the focal length needs to be estimated simultaneously. In this paper, a new method of fast and accurate pose estimation with unknown focal length using two 2D–3D line correspondences and the camera position is proposed. Our core contribution is to convert the PnL (perspective-n-line) problem with 2D–3D line correspondences into an estimation problem with 3D–3D point correspondences. One 3D line and the camera position in the world frame can define a plane, the 2D line projection of the 3D line and the camera position in the camera frame can define another plane, and actually the two planes are the same plane, which is the key geometric characteristic in this paper’s estimation of focal length and pose. We establish the transform between the normal vectors of the two planes with this characteristic, and this transform can be regarded as the camera projection of a 3D point. Then, the pose estimation using 2D–3D line correspondences is converted into pose estimation using 3D–3D point correspondences in intermediate frames, and, lastly, pose estimation can be finished quickly. In addition, using the property whereby the angle between two planes is invariant in both the camera frame and world frame, we can estimate the camera focal length quickly and accurately. Experimental results show that our proposed method has good performance in numerical stability, noise sensitivity and computational speed with synthetic data and real scenarios, and has strong robustness to camera position noise.
format Online
Article
Text
id pubmed-9657983
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96579832022-11-15 Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences Guo, Kai Zhang, Zhixiang Zhang, Zhongsen Tian, Ye Chen, Honglin Sensors (Basel) Article Estimating camera pose is one of the key steps in computer vison, photogrammetry and SLAM (Simultaneous Localization and Mapping). It is mainly calculated based on the 2D–3D correspondences of features, including 2D–3D point and line correspondences. If a zoom lens is equipped, the focal length needs to be estimated simultaneously. In this paper, a new method of fast and accurate pose estimation with unknown focal length using two 2D–3D line correspondences and the camera position is proposed. Our core contribution is to convert the PnL (perspective-n-line) problem with 2D–3D line correspondences into an estimation problem with 3D–3D point correspondences. One 3D line and the camera position in the world frame can define a plane, the 2D line projection of the 3D line and the camera position in the camera frame can define another plane, and actually the two planes are the same plane, which is the key geometric characteristic in this paper’s estimation of focal length and pose. We establish the transform between the normal vectors of the two planes with this characteristic, and this transform can be regarded as the camera projection of a 3D point. Then, the pose estimation using 2D–3D line correspondences is converted into pose estimation using 3D–3D point correspondences in intermediate frames, and, lastly, pose estimation can be finished quickly. In addition, using the property whereby the angle between two planes is invariant in both the camera frame and world frame, we can estimate the camera focal length quickly and accurately. Experimental results show that our proposed method has good performance in numerical stability, noise sensitivity and computational speed with synthetic data and real scenarios, and has strong robustness to camera position noise. MDPI 2022-10-28 /pmc/articles/PMC9657983/ /pubmed/36365950 http://dx.doi.org/10.3390/s22218253 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Guo, Kai
Zhang, Zhixiang
Zhang, Zhongsen
Tian, Ye
Chen, Honglin
Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title_full Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title_fullStr Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title_full_unstemmed Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title_short Fast and Accurate Pose Estimation with Unknown Focal Length Using Line Correspondences
title_sort fast and accurate pose estimation with unknown focal length using line correspondences
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9657983/
https://www.ncbi.nlm.nih.gov/pubmed/36365950
http://dx.doi.org/10.3390/s22218253
work_keys_str_mv AT guokai fastandaccurateposeestimationwithunknownfocallengthusinglinecorrespondences
AT zhangzhixiang fastandaccurateposeestimationwithunknownfocallengthusinglinecorrespondences
AT zhangzhongsen fastandaccurateposeestimationwithunknownfocallengthusinglinecorrespondences
AT tianye fastandaccurateposeestimationwithunknownfocallengthusinglinecorrespondences
AT chenhonglin fastandaccurateposeestimationwithunknownfocallengthusinglinecorrespondences