Cargando…

Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning

Spontaneous eye blink rate (sEBR) has been linked to striatal dopamine function and to how individuals make value-based choices after a period of reinforcement learning (RL). While sEBR is thought to reflect how individuals learn from the negative outcomes of their choices, this idea has not been te...

Descripción completa

Detalles Bibliográficos
Autores principales: Van Slooten, Joanne C., Jahfari, Sara, Theeuwes, Jan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6874684/
https://www.ncbi.nlm.nih.gov/pubmed/31758031
http://dx.doi.org/10.1038/s41598-019-53805-y
_version_ 1783472887378739200
author Van Slooten, Joanne C.
Jahfari, Sara
Theeuwes, Jan
author_facet Van Slooten, Joanne C.
Jahfari, Sara
Theeuwes, Jan
author_sort Van Slooten, Joanne C.
collection PubMed
description Spontaneous eye blink rate (sEBR) has been linked to striatal dopamine function and to how individuals make value-based choices after a period of reinforcement learning (RL). While sEBR is thought to reflect how individuals learn from the negative outcomes of their choices, this idea has not been tested explicitly. This study assessed how individual differences in sEBR relate to learning by focusing on the cognitive processes that drive RL. Using Bayesian latent mixture modelling to quantify the mapping between RL behaviour and its underlying cognitive processes, we were able to differentiate low and high sEBR individuals at the level of these cognitive processes. Further inspection of these cognitive processes indicated that sEBR uniquely indexed explore-exploit tendencies during RL: lower sEBR predicted exploitative choices for high valued options, whereas higher sEBR predicted exploration of lower value options. This relationship was additionally supported by a network analysis where, notably, no link was observed between sEBR and how individuals learned from negative outcomes. Our findings challenge the notion that sEBR predicts learning from negative outcomes during RL, and suggest that sEBR predicts individual explore-exploit tendencies. These then influence value sensitivity during choices to support successful performance when facing uncertain reward.
format Online
Article
Text
id pubmed-6874684
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-68746842019-12-04 Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning Van Slooten, Joanne C. Jahfari, Sara Theeuwes, Jan Sci Rep Article Spontaneous eye blink rate (sEBR) has been linked to striatal dopamine function and to how individuals make value-based choices after a period of reinforcement learning (RL). While sEBR is thought to reflect how individuals learn from the negative outcomes of their choices, this idea has not been tested explicitly. This study assessed how individual differences in sEBR relate to learning by focusing on the cognitive processes that drive RL. Using Bayesian latent mixture modelling to quantify the mapping between RL behaviour and its underlying cognitive processes, we were able to differentiate low and high sEBR individuals at the level of these cognitive processes. Further inspection of these cognitive processes indicated that sEBR uniquely indexed explore-exploit tendencies during RL: lower sEBR predicted exploitative choices for high valued options, whereas higher sEBR predicted exploration of lower value options. This relationship was additionally supported by a network analysis where, notably, no link was observed between sEBR and how individuals learned from negative outcomes. Our findings challenge the notion that sEBR predicts learning from negative outcomes during RL, and suggest that sEBR predicts individual explore-exploit tendencies. These then influence value sensitivity during choices to support successful performance when facing uncertain reward. Nature Publishing Group UK 2019-11-22 /pmc/articles/PMC6874684/ /pubmed/31758031 http://dx.doi.org/10.1038/s41598-019-53805-y Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Van Slooten, Joanne C.
Jahfari, Sara
Theeuwes, Jan
Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title_full Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title_fullStr Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title_full_unstemmed Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title_short Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
title_sort spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6874684/
https://www.ncbi.nlm.nih.gov/pubmed/31758031
http://dx.doi.org/10.1038/s41598-019-53805-y
work_keys_str_mv AT vanslootenjoannec spontaneouseyeblinkratepredictsindividualdifferencesinexplorationandexploitationduringreinforcementlearning
AT jahfarisara spontaneouseyeblinkratepredictsindividualdifferencesinexplorationandexploitationduringreinforcementlearning
AT theeuwesjan spontaneouseyeblinkratepredictsindividualdifferencesinexplorationandexploitationduringreinforcementlearning