Cargando…
HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities
This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cros...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10181470/ https://www.ncbi.nlm.nih.gov/pubmed/37177489 http://dx.doi.org/10.3390/s23094285 |
_version_ | 1785041582219591680 |
---|---|
author | Li, Qing Hu, Shaopeng Shimasaki, Kohei Ishii, Idaku |
author_facet | Li, Qing Hu, Shaopeng Shimasaki, Kohei Ishii, Idaku |
author_sort | Li, Qing |
collection | PubMed |
description | This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cross-camera multiple object correspondence. Most correspondence algorithms rely on texture and color information of the stereo images, making it challenging to distinguish between similar-looking objects, such as ballet dancers and corporate employees wearing similar dresses, or farm animals such as chickens, ducks, and cows. However, by leveraging the low latency and high synchronization of high-speed cameras, we can perceive the phase and frequency differences between the movements of similar-looking objects. In this study, we propose using short-term velocities (STVs) of objects as motion features to determine the correspondence of multiple objects by calculating the similarity of STVs. To validate our approach, we conducted stereo correspondence experiments using markers attached to a metronome and natural hand movements to simulate simple and complex motion scenes. The experimental results demonstrate that our method achieved good performance in stereo correspondence. |
format | Online Article Text |
id | pubmed-10181470 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-101814702023-05-13 HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities Li, Qing Hu, Shaopeng Shimasaki, Kohei Ishii, Idaku Sensors (Basel) Article This study focuses on solving the correspondence problem of multiple moving objects with similar appearances in stereoscopic videos. Specifically, we address the multi-camera correspondence problem by taking into account the pixel-level and feature-level stereo correspondences, and object-level cross-camera multiple object correspondence. Most correspondence algorithms rely on texture and color information of the stereo images, making it challenging to distinguish between similar-looking objects, such as ballet dancers and corporate employees wearing similar dresses, or farm animals such as chickens, ducks, and cows. However, by leveraging the low latency and high synchronization of high-speed cameras, we can perceive the phase and frequency differences between the movements of similar-looking objects. In this study, we propose using short-term velocities (STVs) of objects as motion features to determine the correspondence of multiple objects by calculating the similarity of STVs. To validate our approach, we conducted stereo correspondence experiments using markers attached to a metronome and natural hand movements to simulate simple and complex motion scenes. The experimental results demonstrate that our method achieved good performance in stereo correspondence. MDPI 2023-04-26 /pmc/articles/PMC10181470/ /pubmed/37177489 http://dx.doi.org/10.3390/s23094285 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Li, Qing Hu, Shaopeng Shimasaki, Kohei Ishii, Idaku HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title | HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title_full | HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title_fullStr | HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title_full_unstemmed | HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title_short | HFR-Video-Based Stereo Correspondence Using High Synchronous Short-Term Velocities |
title_sort | hfr-video-based stereo correspondence using high synchronous short-term velocities |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10181470/ https://www.ncbi.nlm.nih.gov/pubmed/37177489 http://dx.doi.org/10.3390/s23094285 |
work_keys_str_mv | AT liqing hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities AT hushaopeng hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities AT shimasakikohei hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities AT ishiiidaku hfrvideobasedstereocorrespondenceusinghighsynchronousshorttermvelocities |