Cargando…

Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared

Thermal infrared imaging is less affected by lighting conditions and smoke compared to visible light imaging. However, thermal infrared images often have lower resolution and lack rich texture details, making them unsuitable for stereo matching and 3D reconstruction. To enhance the quality of infrar...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Huaizhou, Wang, Shuaijun, Bai, Zhenpeng, Wang, Hong, Li, Sen, Wen, Shupei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490217/
https://www.ncbi.nlm.nih.gov/pubmed/37687828
http://dx.doi.org/10.3390/s23177372
_version_ 1785103792784539648
author Li, Huaizhou
Wang, Shuaijun
Bai, Zhenpeng
Wang, Hong
Li, Sen
Wen, Shupei
author_facet Li, Huaizhou
Wang, Shuaijun
Bai, Zhenpeng
Wang, Hong
Li, Sen
Wen, Shupei
author_sort Li, Huaizhou
collection PubMed
description Thermal infrared imaging is less affected by lighting conditions and smoke compared to visible light imaging. However, thermal infrared images often have lower resolution and lack rich texture details, making them unsuitable for stereo matching and 3D reconstruction. To enhance the quality of infrared stereo imaging, we propose an advanced stereo matching algorithm. Firstly, the images undergo preprocessing using a non-local mean noise reduction algorithm to remove thermal noise and achieve a smoother result. Subsequently, we perform camera calibration using a custom-made chessboard calibration board and Zhang’s camera calibration method to obtain accurate camera parameters. Finally, the disparity map is generated using the SGBM (semi-global block matching) algorithm based on the weighted least squares method, enabling the 3D point cloud reconstruction of the object. The experimental results demonstrate that the proposed algorithm performs well in objects with sufficient thermal contrast and relatively simple scenes. The proposed algorithm reduces the average error value by 10.9 mm and the absolute value of the average error by 1.07% when compared with the traditional SGBM algorithm, resulting in improved stereo matching accuracy for thermal infrared imaging. While ensuring accuracy, our proposed algorithm achieves the stereo reconstruction of the object with a good visual effect, thereby holding high practical value.
format Online
Article
Text
id pubmed-10490217
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104902172023-09-09 Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared Li, Huaizhou Wang, Shuaijun Bai, Zhenpeng Wang, Hong Li, Sen Wen, Shupei Sensors (Basel) Article Thermal infrared imaging is less affected by lighting conditions and smoke compared to visible light imaging. However, thermal infrared images often have lower resolution and lack rich texture details, making them unsuitable for stereo matching and 3D reconstruction. To enhance the quality of infrared stereo imaging, we propose an advanced stereo matching algorithm. Firstly, the images undergo preprocessing using a non-local mean noise reduction algorithm to remove thermal noise and achieve a smoother result. Subsequently, we perform camera calibration using a custom-made chessboard calibration board and Zhang’s camera calibration method to obtain accurate camera parameters. Finally, the disparity map is generated using the SGBM (semi-global block matching) algorithm based on the weighted least squares method, enabling the 3D point cloud reconstruction of the object. The experimental results demonstrate that the proposed algorithm performs well in objects with sufficient thermal contrast and relatively simple scenes. The proposed algorithm reduces the average error value by 10.9 mm and the absolute value of the average error by 1.07% when compared with the traditional SGBM algorithm, resulting in improved stereo matching accuracy for thermal infrared imaging. While ensuring accuracy, our proposed algorithm achieves the stereo reconstruction of the object with a good visual effect, thereby holding high practical value. MDPI 2023-08-24 /pmc/articles/PMC10490217/ /pubmed/37687828 http://dx.doi.org/10.3390/s23177372 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Li, Huaizhou
Wang, Shuaijun
Bai, Zhenpeng
Wang, Hong
Li, Sen
Wen, Shupei
Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title_full Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title_fullStr Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title_full_unstemmed Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title_short Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared
title_sort research on 3d reconstruction of binocular vision based on thermal infrared
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490217/
https://www.ncbi.nlm.nih.gov/pubmed/37687828
http://dx.doi.org/10.3390/s23177372
work_keys_str_mv AT lihuaizhou researchon3dreconstructionofbinocularvisionbasedonthermalinfrared
AT wangshuaijun researchon3dreconstructionofbinocularvisionbasedonthermalinfrared
AT baizhenpeng researchon3dreconstructionofbinocularvisionbasedonthermalinfrared
AT wanghong researchon3dreconstructionofbinocularvisionbasedonthermalinfrared
AT lisen researchon3dreconstructionofbinocularvisionbasedonthermalinfrared
AT wenshupei researchon3dreconstructionofbinocularvisionbasedonthermalinfrared