Cargando…
A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality
Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer US
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8717307/ https://www.ncbi.nlm.nih.gov/pubmed/34980945 http://dx.doi.org/10.1007/s11042-021-11723-0 |
_version_ | 1784624503491395584 |
---|---|
author | Jin, Yunshui Ma, Minhua Zhu, Yongning |
author_facet | Jin, Yunshui Ma, Minhua Zhu, Yongning |
author_sort | Jin, Yunshui |
collection | PubMed |
description | Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though it has been several years, the quality of the user experience with narration using HMD-based AR technology has been rarely discussed. The present study explored interactive narrative in HMD-based AR regarding different user interfaces and their influence on users’ presence, narrative engagement and reflection. Inspired by an existing exhibition at the National Holocaust Centre and Museum in the U.K., a HoloLens narrative application, entitled The AR Journey, was developed by the authors using two different interaction methods, Natural User Interface (NUI) and Graphical User Interface (GUI), which were used to perform an empirical study. As revealed from the results of the between-subject design experiment, NUI exhibited statistically significant advantages in creating presence for users without 3D Role Playing Game (RPG) experience, and GUI was superior in creating presence and increasing narrative engagement for users with 3D RPG experience. As indicated by the results of the interviews, the overall narrative experience in HMD-based AR was acceptable, and the branching narrative design was engaging. However, HoloLens hardware issues, as well as virtuality and reality mismatch, adversely affected user experience. Design guidelines were proposed according to the qualitative results. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11042-021-11723-0. |
format | Online Article Text |
id | pubmed-8717307 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer US |
record_format | MEDLINE/PubMed |
spelling | pubmed-87173072021-12-30 A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality Jin, Yunshui Ma, Minhua Zhu, Yongning Multimed Tools Appl Article Over the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) AR Microsoft HoloLens was released. However, though it has been several years, the quality of the user experience with narration using HMD-based AR technology has been rarely discussed. The present study explored interactive narrative in HMD-based AR regarding different user interfaces and their influence on users’ presence, narrative engagement and reflection. Inspired by an existing exhibition at the National Holocaust Centre and Museum in the U.K., a HoloLens narrative application, entitled The AR Journey, was developed by the authors using two different interaction methods, Natural User Interface (NUI) and Graphical User Interface (GUI), which were used to perform an empirical study. As revealed from the results of the between-subject design experiment, NUI exhibited statistically significant advantages in creating presence for users without 3D Role Playing Game (RPG) experience, and GUI was superior in creating presence and increasing narrative engagement for users with 3D RPG experience. As indicated by the results of the interviews, the overall narrative experience in HMD-based AR was acceptable, and the branching narrative design was engaging. However, HoloLens hardware issues, as well as virtuality and reality mismatch, adversely affected user experience. Design guidelines were proposed according to the qualitative results. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11042-021-11723-0. Springer US 2021-12-30 2022 /pmc/articles/PMC8717307/ /pubmed/34980945 http://dx.doi.org/10.1007/s11042-021-11723-0 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Jin, Yunshui Ma, Minhua Zhu, Yongning A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title | A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title_full | A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title_fullStr | A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title_full_unstemmed | A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title_short | A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality |
title_sort | comparison of natural user interface and graphical user interface for narrative in hmd-based augmented reality |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8717307/ https://www.ncbi.nlm.nih.gov/pubmed/34980945 http://dx.doi.org/10.1007/s11042-021-11723-0 |
work_keys_str_mv | AT jinyunshui acomparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality AT maminhua acomparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality AT zhuyongning acomparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality AT jinyunshui comparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality AT maminhua comparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality AT zhuyongning comparisonofnaturaluserinterfaceandgraphicaluserinterfacefornarrativeinhmdbasedaugmentedreality |