Cargando…
The modulation of savouring by prediction error and its effects on choice
When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors ca...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
eLife Sciences Publications, Ltd
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4866828/ https://www.ncbi.nlm.nih.gov/pubmed/27101365 http://dx.doi.org/10.7554/eLife.13747 |
_version_ | 1782431973251219456 |
---|---|
author | Iigaya, Kiyohito Story, Giles W Kurth-Nelson, Zeb Dolan, Raymond J Dayan, Peter |
author_facet | Iigaya, Kiyohito Story, Giles W Kurth-Nelson, Zeb Dolan, Raymond J Dayan, Peter |
author_sort | Iigaya, Kiyohito |
collection | PubMed |
description | When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling. DOI: http://dx.doi.org/10.7554/eLife.13747.001 |
format | Online Article Text |
id | pubmed-4866828 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | eLife Sciences Publications, Ltd |
record_format | MEDLINE/PubMed |
spelling | pubmed-48668282016-05-16 The modulation of savouring by prediction error and its effects on choice Iigaya, Kiyohito Story, Giles W Kurth-Nelson, Zeb Dolan, Raymond J Dayan, Peter eLife Neuroscience When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model could account for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling. DOI: http://dx.doi.org/10.7554/eLife.13747.001 eLife Sciences Publications, Ltd 2016-04-21 /pmc/articles/PMC4866828/ /pubmed/27101365 http://dx.doi.org/10.7554/eLife.13747 Text en © 2016, Iigaya et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited. |
spellingShingle | Neuroscience Iigaya, Kiyohito Story, Giles W Kurth-Nelson, Zeb Dolan, Raymond J Dayan, Peter The modulation of savouring by prediction error and its effects on choice |
title | The modulation of savouring by prediction error and its effects on choice |
title_full | The modulation of savouring by prediction error and its effects on choice |
title_fullStr | The modulation of savouring by prediction error and its effects on choice |
title_full_unstemmed | The modulation of savouring by prediction error and its effects on choice |
title_short | The modulation of savouring by prediction error and its effects on choice |
title_sort | modulation of savouring by prediction error and its effects on choice |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4866828/ https://www.ncbi.nlm.nih.gov/pubmed/27101365 http://dx.doi.org/10.7554/eLife.13747 |
work_keys_str_mv | AT iigayakiyohito themodulationofsavouringbypredictionerroranditseffectsonchoice AT storygilesw themodulationofsavouringbypredictionerroranditseffectsonchoice AT kurthnelsonzeb themodulationofsavouringbypredictionerroranditseffectsonchoice AT dolanraymondj themodulationofsavouringbypredictionerroranditseffectsonchoice AT dayanpeter themodulationofsavouringbypredictionerroranditseffectsonchoice AT iigayakiyohito modulationofsavouringbypredictionerroranditseffectsonchoice AT storygilesw modulationofsavouringbypredictionerroranditseffectsonchoice AT kurthnelsonzeb modulationofsavouringbypredictionerroranditseffectsonchoice AT dolanraymondj modulationofsavouringbypredictionerroranditseffectsonchoice AT dayanpeter modulationofsavouringbypredictionerroranditseffectsonchoice |