Cargando…

ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is...

Descripción completa

Detalles Bibliográficos
Autores principales: Kapp, Sebastian, Barz, Michael, Mukhametov, Sergey, Sonntag, Daniel, Kuhn, Jochen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004990/
https://www.ncbi.nlm.nih.gov/pubmed/33806863
http://dx.doi.org/10.3390/s21062234
_version_ 1783672030628937728
author Kapp, Sebastian
Barz, Michael
Mukhametov, Sergey
Sonntag, Daniel
Kuhn, Jochen
author_facet Kapp, Sebastian
Barz, Michael
Mukhametov, Sergey
Sonntag, Daniel
Kuhn, Jochen
author_sort Kapp, Sebastian
collection PubMed
description Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user ([Formula: see text]). On average, we found that gaze estimates are reported with an angular accuracy of [Formula: see text] degrees and a precision of [Formula: see text] degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.
format Online
Article
Text
id pubmed-8004990
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80049902021-03-29 ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays Kapp, Sebastian Barz, Michael Mukhametov, Sergey Sonntag, Daniel Kuhn, Jochen Sensors (Basel) Article Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user ([Formula: see text]). On average, we found that gaze estimates are reported with an angular accuracy of [Formula: see text] degrees and a precision of [Formula: see text] degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers. MDPI 2021-03-23 /pmc/articles/PMC8004990/ /pubmed/33806863 http://dx.doi.org/10.3390/s21062234 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Kapp, Sebastian
Barz, Michael
Mukhametov, Sergey
Sonntag, Daniel
Kuhn, Jochen
ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_full ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_fullStr ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_full_unstemmed ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_short ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
title_sort arett: augmented reality eye tracking toolkit for head mounted displays
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8004990/
https://www.ncbi.nlm.nih.gov/pubmed/33806863
http://dx.doi.org/10.3390/s21062234
work_keys_str_mv AT kappsebastian arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT barzmichael arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT mukhametovsergey arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT sonntagdaniel arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays
AT kuhnjochen arettaugmentedrealityeyetrackingtoolkitforheadmounteddisplays