Cargando…

HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities

This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cros...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Qing, Hu, Shaopeng, Shimasaki, Kohei, Ishii, Idaku
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10181470/
https://www.ncbi.nlm.nih.gov/pubmed/37177489
http://dx.doi.org/10.3390/s23094285
_version_ 1785041582219591680
author Li, Qing
Hu, Shaopeng
Shimasaki, Kohei
Ishii, Idaku
author_facet Li, Qing
Hu, Shaopeng
Shimasaki, Kohei
Ishii, Idaku
author_sort Li, Qing
collection PubMed
description This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cross-camera multiple object correspondence. Most correspondence algorithms rely on texture and color information of the stereo images, making it challenging to distinguish between similar-looking objects, such as ballet dancers and corporate employees wearing similar dresses, or farm animals such as chickens, ducks, and cows. However, by leveraging the low latency and high synchronization of high-speed cameras, we can perceive the phase and frequency differences between the movements of similar-looking objects. In this study, we propose using short-term velocities (STVs) of objects as motion features to determine the correspondence of multiple objects by calculating the similarity of STVs. To validate our approach, we conducted stereo correspondence experiments using markers attached to a metronome and natural hand movements to simulate simple and complex motion scenes. The experimental results demonstrate that our method achieved good performance in stereo correspondence.
format Online
Article
Text
id pubmed-10181470
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-101814702023-05-13 HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities Li, Qing Hu, Shaopeng Shimasaki, Kohei Ishii, Idaku Sensors (Basel) Article This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cross-camera multiple object correspondence. Most correspondence algorithms rely on texture and color information of the stereo images, making it challenging to distinguish between similar-looking objects, such as ballet dancers and corporate employees wearing similar dresses, or farm animals such as chickens, ducks, and cows. However, by leveraging the low latency and high synchronization of high-speed cameras, we can perceive the phase and frequency differences between the movements of similar-looking objects. In this study, we propose using short-term velocities (STVs) of objects as motion features to determine the correspondence of multiple objects by calculating the similarity of STVs. To validate our approach, we conducted stereo correspondence experiments using markers attached to a metronome and natural hand movements to simulate simple and complex motion scenes. The experimental results demonstrate that our method achieved good performance in stereo correspondence. MDPI 2023-04-26 /pmc/articles/PMC10181470/ /pubmed/37177489 http://dx.doi.org/10.3390/s23094285 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Li, Qing
Hu, Shaopeng
Shimasaki, Kohei
Ishii, Idaku
HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title_full HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title_fullStr HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title_full_unstemmed HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title_short HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
title_sort hfr-video-based stereo correspondence using high synchronous short-term velocities
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10181470/
https://www.ncbi.nlm.nih.gov/pubmed/37177489
http://dx.doi.org/10.3390/s23094285
work_keys_str_mv AT liqing hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities
AT hushaopeng hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities
AT shimasakikohei hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities
AT ishiiidaku hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities