Cargando…
Dissecting Latency in 360° Video Camera Sensing Systems †
360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and f...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9416365/ https://www.ncbi.nlm.nih.gov/pubmed/36015766 http://dx.doi.org/10.3390/s22166001 |
_version_ | 1784776462414381056 |
---|---|
author | Yan, Zhisheng Yi, Jun |
author_facet | Yan, Zhisheng Yi, Jun |
author_sort | Yan, Zhisheng |
collection | PubMed |
description | 360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and frame rate. Therefore, understanding the time consumption of computing tasks in 360° video camera sensing becomes the prerequisite to improving the system’s delay performance and viewing experience. Despite the prior measurement studies on 360° video systems, none of them delves into the system pipeline and dissects the latency at the task level. In this paper, we perform the first in-depth measurement study of task-level time consumption for 360° video camera sensing. We start with identifying the subtle relationship between the three delay metrics and the time consumption breakdown across the system computing task. Next, we develop an open research prototype Zeus to characterize this relationship in various realistic usage scenarios. Our measurement of task-level time consumption demonstrates the importance of the camera CPU-GPU transfer and the server initialization, as well as the negligible effect of 360° video stitching on the delay metrics. Finally, we compare Zeus with a commercial system to validate that our results are representative and can be used to improve today’s 360° video camera sensing systems. |
format | Online Article Text |
id | pubmed-9416365 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-94163652022-08-27 Dissecting Latency in 360° Video Camera Sensing Systems † Yan, Zhisheng Yi, Jun Sensors (Basel) Article 360° video camera sensing is an increasingly popular technology. Compared with traditional 2D video systems, it is challenging to ensure the viewing experience in 360° video camera sensing because the massive omnidirectional data introduce adverse effects on start-up delay, event-to-eye delay, and frame rate. Therefore, understanding the time consumption of computing tasks in 360° video camera sensing becomes the prerequisite to improving the system’s delay performance and viewing experience. Despite the prior measurement studies on 360° video systems, none of them delves into the system pipeline and dissects the latency at the task level. In this paper, we perform the first in-depth measurement study of task-level time consumption for 360° video camera sensing. We start with identifying the subtle relationship between the three delay metrics and the time consumption breakdown across the system computing task. Next, we develop an open research prototype Zeus to characterize this relationship in various realistic usage scenarios. Our measurement of task-level time consumption demonstrates the importance of the camera CPU-GPU transfer and the server initialization, as well as the negligible effect of 360° video stitching on the delay metrics. Finally, we compare Zeus with a commercial system to validate that our results are representative and can be used to improve today’s 360° video camera sensing systems. MDPI 2022-08-11 /pmc/articles/PMC9416365/ /pubmed/36015766 http://dx.doi.org/10.3390/s22166001 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Yan, Zhisheng Yi, Jun Dissecting Latency in 360° Video Camera Sensing Systems † |
title | Dissecting Latency in 360° Video Camera Sensing Systems † |
title_full | Dissecting Latency in 360° Video Camera Sensing Systems † |
title_fullStr | Dissecting Latency in 360° Video Camera Sensing Systems † |
title_full_unstemmed | Dissecting Latency in 360° Video Camera Sensing Systems † |
title_short | Dissecting Latency in 360° Video Camera Sensing Systems † |
title_sort | dissecting latency in 360° video camera sensing systems † |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9416365/ https://www.ncbi.nlm.nih.gov/pubmed/36015766 http://dx.doi.org/10.3390/s22166001 |
work_keys_str_mv | AT yanzhisheng dissectinglatencyin360videocamerasensingsystems AT yijun dissectinglatencyin360videocamerasensingsystems |