Cargando…

Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach

Although our pupils slightly dilate when we look at an intended target, they do not when we look at irrelevant distractors. This finding suggests that it may be possible to decode the intention of an observer, understood as the outcome of implicit covert binary decisions, from the pupillary dynamics...

Descripción completa

Detalles Bibliográficos
Autores principales: Strauch, Christoph, Hirzle, Teresa, Van der Stigchel, Stefan, Bulling, Andreas
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Association for Research in Vision and Ophthalmology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288052/
https://www.ncbi.nlm.nih.gov/pubmed/34259827
http://dx.doi.org/10.1167/jov.21.7.6
_version_ 1783724024882266112
author Strauch, Christoph
Hirzle, Teresa
Van der Stigchel, Stefan
Bulling, Andreas
author_facet Strauch, Christoph
Hirzle, Teresa
Van der Stigchel, Stefan
Bulling, Andreas
author_sort Strauch, Christoph
collection PubMed
description Although our pupils slightly dilate when we look at an intended target, they do not when we look at irrelevant distractors. This finding suggests that it may be possible to decode the intention of an observer, understood as the outcome of implicit covert binary decisions, from the pupillary dynamics over time. However, few previous works have investigated the feasibility of this approach and the few that did, did not control for possible confounds such as motor-execution, changes in brightness, or target and distractor probability. We report on our efforts to decode intentions from pupil dilation obtained under strict experimental control on a single trial basis using a machine learning approach. The basis for our analyses are data of 69 participants who looked at letters that needed to be selected with stimulus probabilities that varied systematically in a blockwise manner (n = 19,417 trials). We confirm earlier findings that pupil dilation is indicative of intentions and show that these can be decoded with a classification performance of up to 76% area under the curve for receiver operating characteristic curves if targets are rarer than distractors. To better understand which characteristics of the pupillary signal are most informative, we finally compare relative feature importances. The first derivative of pupil size changes was found to be most relevant, allowing us to decode intention within only about 800 ms of trial onset. Taken together, our results provide credible insights into the potential of decoding intentions from pupil dilation and may soon form the basis for new applications in visual search, gaze-based interaction, or human–robot interaction.
format Online
Article
Text
id pubmed-8288052
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Association for Research in Vision and Ophthalmology
record_format MEDLINE/PubMed
spelling pubmed-82880522021-07-26 Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach Strauch, Christoph Hirzle, Teresa Van der Stigchel, Stefan Bulling, Andreas J Vis Article Although our pupils slightly dilate when we look at an intended target, they do not when we look at irrelevant distractors. This finding suggests that it may be possible to decode the intention of an observer, understood as the outcome of implicit covert binary decisions, from the pupillary dynamics over time. However, few previous works have investigated the feasibility of this approach and the few that did, did not control for possible confounds such as motor-execution, changes in brightness, or target and distractor probability. We report on our efforts to decode intentions from pupil dilation obtained under strict experimental control on a single trial basis using a machine learning approach. The basis for our analyses are data of 69 participants who looked at letters that needed to be selected with stimulus probabilities that varied systematically in a blockwise manner (n = 19,417 trials). We confirm earlier findings that pupil dilation is indicative of intentions and show that these can be decoded with a classification performance of up to 76% area under the curve for receiver operating characteristic curves if targets are rarer than distractors. To better understand which characteristics of the pupillary signal are most informative, we finally compare relative feature importances. The first derivative of pupil size changes was found to be most relevant, allowing us to decode intention within only about 800 ms of trial onset. Taken together, our results provide credible insights into the potential of decoding intentions from pupil dilation and may soon form the basis for new applications in visual search, gaze-based interaction, or human–robot interaction. The Association for Research in Vision and Ophthalmology 2021-07-14 /pmc/articles/PMC8288052/ /pubmed/34259827 http://dx.doi.org/10.1167/jov.21.7.6 Text en Copyright 2021 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
spellingShingle Article
Strauch, Christoph
Hirzle, Teresa
Van der Stigchel, Stefan
Bulling, Andreas
Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title_full Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title_fullStr Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title_full_unstemmed Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title_short Decoding binary decisions under differential target probabilities from pupil dilation: A random forest approach
title_sort decoding binary decisions under differential target probabilities from pupil dilation: a random forest approach
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288052/
https://www.ncbi.nlm.nih.gov/pubmed/34259827
http://dx.doi.org/10.1167/jov.21.7.6
work_keys_str_mv AT strauchchristoph decodingbinarydecisionsunderdifferentialtargetprobabilitiesfrompupildilationarandomforestapproach
AT hirzleteresa decodingbinarydecisionsunderdifferentialtargetprobabilitiesfrompupildilationarandomforestapproach
AT vanderstigchelstefan decodingbinarydecisionsunderdifferentialtargetprobabilitiesfrompupildilationarandomforestapproach
AT bullingandreas decodingbinarydecisionsunderdifferentialtargetprobabilitiesfrompupildilationarandomforestapproach