Cargando…

Explicit neural signals reflecting reward uncertainty

The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distri...

Descripción completa

Detalles Bibliográficos
Autores principales: Schultz, Wolfram, Preuschoff, Kerstin, Camerer, Colin, Hsu, Ming, Fiorillo, Christopher D, Tobler, Philippe N, Bossaerts, Peter
Formato: Texto
Lenguaje:English
Publicado: The Royal Society 2008
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2581779/
https://www.ncbi.nlm.nih.gov/pubmed/18829433
http://dx.doi.org/10.1098/rstb.2008.0152
_version_ 1782160642399010816
author Schultz, Wolfram
Preuschoff, Kerstin
Camerer, Colin
Hsu, Ming
Fiorillo, Christopher D
Tobler, Philippe N
Bossaerts, Peter
author_facet Schultz, Wolfram
Preuschoff, Kerstin
Camerer, Colin
Hsu, Ming
Fiorillo, Christopher D
Tobler, Philippe N
Bossaerts, Peter
author_sort Schultz, Wolfram
collection PubMed
description The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options.
format Text
id pubmed-2581779
institution National Center for Biotechnology Information
language English
publishDate 2008
publisher The Royal Society
record_format MEDLINE/PubMed
spelling pubmed-25817792008-12-29 Explicit neural signals reflecting reward uncertainty Schultz, Wolfram Preuschoff, Kerstin Camerer, Colin Hsu, Ming Fiorillo, Christopher D Tobler, Philippe N Bossaerts, Peter Philos Trans R Soc Lond B Biol Sci Review The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options. The Royal Society 2008-10-01 2008-12-12 /pmc/articles/PMC2581779/ /pubmed/18829433 http://dx.doi.org/10.1098/rstb.2008.0152 Text en Copyright © 2008 The Royal Society http://creativecommons.org/licenses/by/2.5/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Review
Schultz, Wolfram
Preuschoff, Kerstin
Camerer, Colin
Hsu, Ming
Fiorillo, Christopher D
Tobler, Philippe N
Bossaerts, Peter
Explicit neural signals reflecting reward uncertainty
title Explicit neural signals reflecting reward uncertainty
title_full Explicit neural signals reflecting reward uncertainty
title_fullStr Explicit neural signals reflecting reward uncertainty
title_full_unstemmed Explicit neural signals reflecting reward uncertainty
title_short Explicit neural signals reflecting reward uncertainty
title_sort explicit neural signals reflecting reward uncertainty
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2581779/
https://www.ncbi.nlm.nih.gov/pubmed/18829433
http://dx.doi.org/10.1098/rstb.2008.0152
work_keys_str_mv AT schultzwolfram explicitneuralsignalsreflectingrewarduncertainty
AT preuschoffkerstin explicitneuralsignalsreflectingrewarduncertainty
AT camerercolin explicitneuralsignalsreflectingrewarduncertainty
AT hsuming explicitneuralsignalsreflectingrewarduncertainty
AT fiorillochristopherd explicitneuralsignalsreflectingrewarduncertainty
AT toblerphilippen explicitneuralsignalsreflectingrewarduncertainty
AT bossaertspeter explicitneuralsignalsreflectingrewarduncertainty