Cargando…

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimi...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Xinhua, Li, Dayu, Zhang, Guang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7998483/
https://www.ncbi.nlm.nih.gov/pubmed/33802076
http://dx.doi.org/10.3390/s21061944
_version_ 1783670562684403712
author Wang, Xinhua
Li, Dayu
Zhang, Guang
author_facet Wang, Xinhua
Li, Dayu
Zhang, Guang
author_sort Wang, Xinhua
collection PubMed
description With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions.
format Online
Article
Text
id pubmed-7998483
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-79984832021-03-28 Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision Wang, Xinhua Li, Dayu Zhang, Guang Sensors (Basel) Article With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions. MDPI 2021-03-10 /pmc/articles/PMC7998483/ /pubmed/33802076 http://dx.doi.org/10.3390/s21061944 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Xinhua
Li, Dayu
Zhang, Guang
Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title_full Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title_fullStr Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title_full_unstemmed Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title_short Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
title_sort panoramic stereo imaging of a bionic compound-eye based on binocular vision
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7998483/
https://www.ncbi.nlm.nih.gov/pubmed/33802076
http://dx.doi.org/10.3390/s21061944
work_keys_str_mv AT wangxinhua panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision
AT lidayu panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision
AT zhangguang panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision