Cargando…

Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum

In a complex and uncertain world, how do we select appropriate behavior? One possibility is that we choose actions that are highly reinforced by their probabilistic consequences (model-free processing). However, we may instead plan actions prior to their actual execution by predicting their conseque...

Descripción completa

Detalles Bibliográficos
Autores principales: Tanaka, Shingo, Pan, Xiaochuan, Oguchi, Mineki, Taylor, Jessica E., Sakagami, Masamichi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2015
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4503889/
https://www.ncbi.nlm.nih.gov/pubmed/26236266
http://dx.doi.org/10.3389/fpsyg.2015.00995
_version_ 1782381385530474496
author Tanaka, Shingo
Pan, Xiaochuan
Oguchi, Mineki
Taylor, Jessica E.
Sakagami, Masamichi
author_facet Tanaka, Shingo
Pan, Xiaochuan
Oguchi, Mineki
Taylor, Jessica E.
Sakagami, Masamichi
author_sort Tanaka, Shingo
collection PubMed
description In a complex and uncertain world, how do we select appropriate behavior? One possibility is that we choose actions that are highly reinforced by their probabilistic consequences (model-free processing). However, we may instead plan actions prior to their actual execution by predicting their consequences (model-based processing). It has been suggested that the brain contains multiple yet distinct systems involved in reward prediction. Several studies have tried to allocate model-free and model-based systems to the striatum and the lateral prefrontal cortex (LPFC), respectively. Although there is much support for this hypothesis, recent research has revealed discrepancies. To understand the nature of the reward prediction systems in the LPFC and the striatum, a series of single-unit recording experiments were conducted. LPFC neurons were found to infer the reward associated with the stimuli even when the monkeys had not yet learned the stimulus-reward (SR) associations directly. Striatal neurons seemed to predict the reward for each stimulus only after directly experiencing the SR contingency. However, the one exception was “Exclusive Or” situations in which striatal neurons could predict the reward without direct experience. Previous single-unit studies in monkeys have reported that neurons in the LPFC encode category information, and represent reward information specific to a group of stimuli. Here, as an extension of these, we review recent evidence that a group of LPFC neurons can predict reward specific to a category of visual stimuli defined by relevant behavioral responses. We suggest that the functional difference in reward prediction between the LPFC and the striatum is that while LPFC neurons can utilize abstract code, striatal neurons can code individual associations between stimuli and reward but cannot utilize abstract code.
format Online
Article
Text
id pubmed-4503889
institution National Center for Biotechnology Information
language English
publishDate 2015
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-45038892015-07-31 Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum Tanaka, Shingo Pan, Xiaochuan Oguchi, Mineki Taylor, Jessica E. Sakagami, Masamichi Front Psychol Neuroscience In a complex and uncertain world, how do we select appropriate behavior? One possibility is that we choose actions that are highly reinforced by their probabilistic consequences (model-free processing). However, we may instead plan actions prior to their actual execution by predicting their consequences (model-based processing). It has been suggested that the brain contains multiple yet distinct systems involved in reward prediction. Several studies have tried to allocate model-free and model-based systems to the striatum and the lateral prefrontal cortex (LPFC), respectively. Although there is much support for this hypothesis, recent research has revealed discrepancies. To understand the nature of the reward prediction systems in the LPFC and the striatum, a series of single-unit recording experiments were conducted. LPFC neurons were found to infer the reward associated with the stimuli even when the monkeys had not yet learned the stimulus-reward (SR) associations directly. Striatal neurons seemed to predict the reward for each stimulus only after directly experiencing the SR contingency. However, the one exception was “Exclusive Or” situations in which striatal neurons could predict the reward without direct experience. Previous single-unit studies in monkeys have reported that neurons in the LPFC encode category information, and represent reward information specific to a group of stimuli. Here, as an extension of these, we review recent evidence that a group of LPFC neurons can predict reward specific to a category of visual stimuli defined by relevant behavioral responses. We suggest that the functional difference in reward prediction between the LPFC and the striatum is that while LPFC neurons can utilize abstract code, striatal neurons can code individual associations between stimuli and reward but cannot utilize abstract code. Frontiers Media S.A. 2015-07-16 /pmc/articles/PMC4503889/ /pubmed/26236266 http://dx.doi.org/10.3389/fpsyg.2015.00995 Text en Copyright © 2015 Tanaka, Pan, Oguchi, Taylor and Sakagami. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Tanaka, Shingo
Pan, Xiaochuan
Oguchi, Mineki
Taylor, Jessica E.
Sakagami, Masamichi
Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title_full Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title_fullStr Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title_full_unstemmed Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title_short Dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
title_sort dissociable functions of reward inference in the lateral prefrontal cortex and the striatum
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4503889/
https://www.ncbi.nlm.nih.gov/pubmed/26236266
http://dx.doi.org/10.3389/fpsyg.2015.00995
work_keys_str_mv AT tanakashingo dissociablefunctionsofrewardinferenceinthelateralprefrontalcortexandthestriatum
AT panxiaochuan dissociablefunctionsofrewardinferenceinthelateralprefrontalcortexandthestriatum
AT oguchimineki dissociablefunctionsofrewardinferenceinthelateralprefrontalcortexandthestriatum
AT taylorjessicae dissociablefunctionsofrewardinferenceinthelateralprefrontalcortexandthestriatum
AT sakagamimasamichi dissociablefunctionsofrewardinferenceinthelateralprefrontalcortexandthestriatum