Cargando…

Neural Representation of Costs and Rewards in Decision Making

Decision making is crucial for animal survival because the choices they make based on their current situation could influence their future rewards and could have potential costs. This review summarises recent developments in decision making, discusses how rewards and costs could be encoded in the br...

Descripción completa

Detalles Bibliográficos
Autor principal: Chen, Yixuan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8391424/
https://www.ncbi.nlm.nih.gov/pubmed/34439715
http://dx.doi.org/10.3390/brainsci11081096
_version_ 1783743271437074432
author Chen, Yixuan
author_facet Chen, Yixuan
author_sort Chen, Yixuan
collection PubMed
description Decision making is crucial for animal survival because the choices they make based on their current situation could influence their future rewards and could have potential costs. This review summarises recent developments in decision making, discusses how rewards and costs could be encoded in the brain, and how different options are compared such that the most optimal one is chosen. The reward and cost are mainly encoded by the forebrain structures (e.g., anterior cingulate cortex, orbitofrontal cortex), and their value is updated through learning. The recent development on dopamine and the lateral habenula’s role in reporting prediction errors and instructing learning will be emphasised. The importance of dopamine in powering the choice and accounting for the internal state will also be discussed. While the orbitofrontal cortex is the place where the state values are stored, the anterior cingulate cortex is more important when the environment is volatile. All of these structures compare different attributes of the task simultaneously, and the local competition of different neuronal networks allows for the selection of the most appropriate one. Therefore, the total value of the task is not encoded as a scalar quantity in the brain but, instead, as an emergent phenomenon, arising from the computation at different brain regions.
format Online
Article
Text
id pubmed-8391424
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83914242021-08-28 Neural Representation of Costs and Rewards in Decision Making Chen, Yixuan Brain Sci Review Decision making is crucial for animal survival because the choices they make based on their current situation could influence their future rewards and could have potential costs. This review summarises recent developments in decision making, discusses how rewards and costs could be encoded in the brain, and how different options are compared such that the most optimal one is chosen. The reward and cost are mainly encoded by the forebrain structures (e.g., anterior cingulate cortex, orbitofrontal cortex), and their value is updated through learning. The recent development on dopamine and the lateral habenula’s role in reporting prediction errors and instructing learning will be emphasised. The importance of dopamine in powering the choice and accounting for the internal state will also be discussed. While the orbitofrontal cortex is the place where the state values are stored, the anterior cingulate cortex is more important when the environment is volatile. All of these structures compare different attributes of the task simultaneously, and the local competition of different neuronal networks allows for the selection of the most appropriate one. Therefore, the total value of the task is not encoded as a scalar quantity in the brain but, instead, as an emergent phenomenon, arising from the computation at different brain regions. MDPI 2021-08-20 /pmc/articles/PMC8391424/ /pubmed/34439715 http://dx.doi.org/10.3390/brainsci11081096 Text en © 2021 by the author. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Chen, Yixuan
Neural Representation of Costs and Rewards in Decision Making
title Neural Representation of Costs and Rewards in Decision Making
title_full Neural Representation of Costs and Rewards in Decision Making
title_fullStr Neural Representation of Costs and Rewards in Decision Making
title_full_unstemmed Neural Representation of Costs and Rewards in Decision Making
title_short Neural Representation of Costs and Rewards in Decision Making
title_sort neural representation of costs and rewards in decision making
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8391424/
https://www.ncbi.nlm.nih.gov/pubmed/34439715
http://dx.doi.org/10.3390/brainsci11081096
work_keys_str_mv AT chenyixuan neuralrepresentationofcostsandrewardsindecisionmaking