Cargando…

The modulation of savouring by prediction error and its effects on choice

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors ca...

Descripción completa

Detalles Bibliográficos
Autores principales: Iigaya, Kiyohito, Story, Giles W, Kurth-Nelson, Zeb, Dolan, Raymond J, Dayan, Peter
Formato: Online Artículo Texto
Lenguaje:English
Publicado: eLife Sciences Publications, Ltd 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4866828/
https://www.ncbi.nlm.nih.gov/pubmed/27101365
http://dx.doi.org/10.7554/eLife.13747
_version_ 1782431973251219456
author Iigaya, Kiyohito
Story, Giles W
Kurth-Nelson, Zeb
Dolan, Raymond J
Dayan, Peter
author_facet Iigaya, Kiyohito
Story, Giles W
Kurth-Nelson, Zeb
Dolan, Raymond J
Dayan, Peter
author_sort Iigaya, Kiyohito
collection PubMed
description When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling. DOI: http://dx.doi.org/10.7554/eLife.13747.001
format Online
Article
Text
id pubmed-4866828
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher eLife Sciences Publications, Ltd
record_format MEDLINE/PubMed
spelling pubmed-48668282016-05-16 The modulation of savouring by prediction error and its effects on choice Iigaya, Kiyohito Story, Giles W Kurth-Nelson, Zeb Dolan, Raymond J Dayan, Peter eLife Neuroscience When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling. DOI: http://dx.doi.org/10.7554/eLife.13747.001 eLife Sciences Publications, Ltd 2016-04-21 /pmc/articles/PMC4866828/ /pubmed/27101365 http://dx.doi.org/10.7554/eLife.13747 Text en © 2016, Iigaya et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited.
spellingShingle Neuroscience
Iigaya, Kiyohito
Story, Giles W
Kurth-Nelson, Zeb
Dolan, Raymond J
Dayan, Peter
The modulation of savouring by prediction error and its effects on choice
title The modulation of savouring by prediction error and its effects on choice
title_full The modulation of savouring by prediction error and its effects on choice
title_fullStr The modulation of savouring by prediction error and its effects on choice
title_full_unstemmed The modulation of savouring by prediction error and its effects on choice
title_short The modulation of savouring by prediction error and its effects on choice
title_sort modulation of savouring by prediction error and its effects on choice
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4866828/
https://www.ncbi.nlm.nih.gov/pubmed/27101365
http://dx.doi.org/10.7554/eLife.13747
work_keys_str_mv AT iigayakiyohito themodulationofsavouringbypredictionerroranditseffectsonchoice
AT storygilesw themodulationofsavouringbypredictionerroranditseffectsonchoice
AT kurthnelsonzeb themodulationofsavouringbypredictionerroranditseffectsonchoice
AT dolanraymondj themodulationofsavouringbypredictionerroranditseffectsonchoice
AT dayanpeter themodulationofsavouringbypredictionerroranditseffectsonchoice
AT iigayakiyohito modulationofsavouringbypredictionerroranditseffectsonchoice
AT storygilesw modulationofsavouringbypredictionerroranditseffectsonchoice
AT kurthnelsonzeb modulationofsavouringbypredictionerroranditseffectsonchoice
AT dolanraymondj modulationofsavouringbypredictionerroranditseffectsonchoice
AT dayanpeter modulationofsavouringbypredictionerroranditseffectsonchoice