Cargando…
Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision
With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimi...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7998483/ https://www.ncbi.nlm.nih.gov/pubmed/33802076 http://dx.doi.org/10.3390/s21061944 |
_version_ | 1783670562684403712 |
---|---|
author | Wang, Xinhua Li, Dayu Zhang, Guang |
author_facet | Wang, Xinhua Li, Dayu Zhang, Guang |
author_sort | Wang, Xinhua |
collection | PubMed |
description | With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions. |
format | Online Article Text |
id | pubmed-7998483 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-79984832021-03-28 Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision Wang, Xinhua Li, Dayu Zhang, Guang Sensors (Basel) Article With the rapid development of the virtual reality industry, one of the bottlenecks is the scarcity of video resources. How to capture high-definition panoramic video with depth information and real-time stereo display has become a key technical problem to be solved. In this paper, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed. Combined with the real-time processing algorithm of multi detector mosaic panoramic stereo imaging image, a panoramic stereo real-time imaging system is developed. Firstly, the optical optimization design scheme of panoramic imaging based on binocular stereo vision is proposed, and the space coordinate calibration platform of ultra-high precision panoramic camera based on theodolite angle compensation function is constructed. The projection matrix of adjacent cameras is obtained by solving the imaging principle of binocular stereo vision. Then, a real-time registration algorithm of multi-detector mosaic image and Lucas-Kanade optical flow method based on image segmentation are proposed to realize stereo matching and depth information estimation of panoramic imaging, and the estimation results are analyzed effectively. Experimental results show that the stereo matching time of panoramic imaging is 30 ms, the registration accuracy is 0.1 pixel, the edge information of depth map is clearer, and it can meet the imaging requirements of different lighting conditions. MDPI 2021-03-10 /pmc/articles/PMC7998483/ /pubmed/33802076 http://dx.doi.org/10.3390/s21061944 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Xinhua Li, Dayu Zhang, Guang Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title | Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title_full | Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title_fullStr | Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title_full_unstemmed | Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title_short | Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision |
title_sort | panoramic stereo imaging of a bionic compound-eye based on binocular vision |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7998483/ https://www.ncbi.nlm.nih.gov/pubmed/33802076 http://dx.doi.org/10.3390/s21061944 |
work_keys_str_mv | AT wangxinhua panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision AT lidayu panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision AT zhangguang panoramicstereoimagingofabioniccompoundeyebasedonbinocularvision |