Cargando…

The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments

In the mixed reality (MR) environment, the task of target motion perception is usually undertaken by vision. This approach suffers from poor discrimination and high cognitive load when the tasks are complex. This cannot meet the needs of the air traffic control field for rapid capture and precise po...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Wei, Xu, Ning, Liu, Haiping, Qu, Jue, Dang, Sina, Hong, Xuefeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9695400/
https://www.ncbi.nlm.nih.gov/pubmed/36433528
http://dx.doi.org/10.3390/s22228931
_version_ 1784838050311831552
author Wang, Wei
Xu, Ning
Liu, Haiping
Qu, Jue
Dang, Sina
Hong, Xuefeng
author_facet Wang, Wei
Xu, Ning
Liu, Haiping
Qu, Jue
Dang, Sina
Hong, Xuefeng
author_sort Wang, Wei
collection PubMed
description In the mixed reality (MR) environment, the task of target motion perception is usually undertaken by vision. This approach suffers from poor discrimination and high cognitive load when the tasks are complex. This cannot meet the needs of the air traffic control field for rapid capture and precise positioning of the dynamic targets in the air. Based on this problem, we conducted a multimodal optimization study on target motion perception judgment by controlling the hand tactile sensor to achieve the use of tactile sensation to assist vision in MR environment. This allows it to adapt to the requirements of future development-led interactive tasks under the mixed reality holographic aviation tower. Motion perception tasks are usually divided into urgency sensing for multiple targets and precise position tracking for single targets according to the number of targets and task division. Therefore, in this paper, we designed experiments to investigate the correlation between tactile intensity-velocity correspondence and target urgency, and the correlation between the PRS (position, rhythm, sequence) tactile indication scheme and position tracking. We also evaluated it through comprehensive experiment. We obtained the following conclusions: (1) high, higher, medium, lower, and low tactile intensities would bias human visual cognitive induction to fast, faster, medium, slower, and slow motion targets. Additionally, this correspondence can significantly improve the efficiency of the participants’ judgment of target urgency; (2) under the PRS tactile indication scheme, position-based rhythm and sequence cues can improve the judgment effect of human tracking target dynamic position, and the effect of adding rhythm cues is better. However, when adding rhythm and sequence cues at the same time, it can cause clutter; (3) tactile assisted vision has a good improvement effect on the comprehensive perception of dynamic target movement. The above findings are useful for the study of target motion perception in MR environments and provide a theoretical basis for subsequent research on the cognitive mechanism and quantitative of tactile indication in MR environment.
format Online
Article
Text
id pubmed-9695400
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96954002022-11-26 The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments Wang, Wei Xu, Ning Liu, Haiping Qu, Jue Dang, Sina Hong, Xuefeng Sensors (Basel) Article In the mixed reality (MR) environment, the task of target motion perception is usually undertaken by vision. This approach suffers from poor discrimination and high cognitive load when the tasks are complex. This cannot meet the needs of the air traffic control field for rapid capture and precise positioning of the dynamic targets in the air. Based on this problem, we conducted a multimodal optimization study on target motion perception judgment by controlling the hand tactile sensor to achieve the use of tactile sensation to assist vision in MR environment. This allows it to adapt to the requirements of future development-led interactive tasks under the mixed reality holographic aviation tower. Motion perception tasks are usually divided into urgency sensing for multiple targets and precise position tracking for single targets according to the number of targets and task division. Therefore, in this paper, we designed experiments to investigate the correlation between tactile intensity-velocity correspondence and target urgency, and the correlation between the PRS (position, rhythm, sequence) tactile indication scheme and position tracking. We also evaluated it through comprehensive experiment. We obtained the following conclusions: (1) high, higher, medium, lower, and low tactile intensities would bias human visual cognitive induction to fast, faster, medium, slower, and slow motion targets. Additionally, this correspondence can significantly improve the efficiency of the participants’ judgment of target urgency; (2) under the PRS tactile indication scheme, position-based rhythm and sequence cues can improve the judgment effect of human tracking target dynamic position, and the effect of adding rhythm cues is better. However, when adding rhythm and sequence cues at the same time, it can cause clutter; (3) tactile assisted vision has a good improvement effect on the comprehensive perception of dynamic target movement. The above findings are useful for the study of target motion perception in MR environments and provide a theoretical basis for subsequent research on the cognitive mechanism and quantitative of tactile indication in MR environment. MDPI 2022-11-18 /pmc/articles/PMC9695400/ /pubmed/36433528 http://dx.doi.org/10.3390/s22228931 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Wei
Xu, Ning
Liu, Haiping
Qu, Jue
Dang, Sina
Hong, Xuefeng
The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title_full The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title_fullStr The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title_full_unstemmed The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title_short The Dynamic Target Motion Perception Mechanism of Tactile-Assisted Vision in MR Environments
title_sort dynamic target motion perception mechanism of tactile-assisted vision in mr environments
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9695400/
https://www.ncbi.nlm.nih.gov/pubmed/36433528
http://dx.doi.org/10.3390/s22228931
work_keys_str_mv AT wangwei thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT xuning thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT liuhaiping thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT qujue thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT dangsina thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT hongxuefeng thedynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT wangwei dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT xuning dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT liuhaiping dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT qujue dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT dangsina dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments
AT hongxuefeng dynamictargetmotionperceptionmechanismoftactileassistedvisioninmrenvironments