Cargando…

Dissecting Latency in 360° Video Camera Sensing Systems †

360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and f...

Descripción completa

Detalles Bibliográficos
Autores principales: Yan, Zhisheng, Yi, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9416365/
https://www.ncbi.nlm.nih.gov/pubmed/36015766
http://dx.doi.org/10.3390/s22166001
_version_ 1784776462414381056
author Yan, Zhisheng
Yi, Jun
author_facet Yan, Zhisheng
Yi, Jun
author_sort Yan, Zhisheng
collection PubMed
description 360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and frame rate. Therefore, understanding the time consumption of computing tasks in 360° video camera sensing becomes the prerequisite to improving the system’s delay performance and viewing experience. Despite the prior measurement studies on 360° video systems, none of them delves into the system pipeline and dissects the latency at the task level. In this paper, we perform the first in-depth measurement study of task-level time consumption for 360° video camera sensing. We start with identifying the subtle relationship between the three delay metrics and the time consumption breakdown across the system computing task. Next, we develop an open research prototype Zeus to characterize this relationship in various realistic usage scenarios. Our measurement of task-level time consumption demonstrates the importance of the camera CPU-GPU transfer and the server initialization, as well as the negligible effect of 360° video stitching on the delay metrics. Finally, we compare Zeus with a commercial system to validate that our results are representative and can be used to improve today’s 360° video camera sensing systems.
format Online
Article
Text
id pubmed-9416365
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-94163652022-08-27 Dissecting Latency in 360° Video Camera Sensing Systems † Yan, Zhisheng Yi, Jun Sensors (Basel) Article 360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and frame rate. Therefore, understanding the time consumption of computing tasks in 360° video camera sensing becomes the prerequisite to improving the system’s delay performance and viewing experience. Despite the prior measurement studies on 360° video systems, none of them delves into the system pipeline and dissects the latency at the task level. In this paper, we perform the first in-depth measurement study of task-level time consumption for 360° video camera sensing. We start with identifying the subtle relationship between the three delay metrics and the time consumption breakdown across the system computing task. Next, we develop an open research prototype Zeus to characterize this relationship in various realistic usage scenarios. Our measurement of task-level time consumption demonstrates the importance of the camera CPU-GPU transfer and the server initialization, as well as the negligible effect of 360° video stitching on the delay metrics. Finally, we compare Zeus with a commercial system to validate that our results are representative and can be used to improve today’s 360° video camera sensing systems. MDPI 2022-08-11 /pmc/articles/PMC9416365/ /pubmed/36015766 http://dx.doi.org/10.3390/s22166001 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yan, Zhisheng
Yi, Jun
Dissecting Latency in 360° Video Camera Sensing Systems †
title Dissecting Latency in 360° Video Camera Sensing Systems †
title_full Dissecting Latency in 360° Video Camera Sensing Systems †
title_fullStr Dissecting Latency in 360° Video Camera Sensing Systems †
title_full_unstemmed Dissecting Latency in 360° Video Camera Sensing Systems †
title_short Dissecting Latency in 360° Video Camera Sensing Systems †
title_sort dissecting latency in 360° video camera sensing systems †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9416365/
https://www.ncbi.nlm.nih.gov/pubmed/36015766
http://dx.doi.org/10.3390/s22166001
work_keys_str_mv AT yanzhisheng dissectinglatencyin360videocamerasensingsystems
AT yijun dissectinglatencyin360videocamerasensingsystems