Cargando…

Orbitofrontal neurons signal reward predictions, not reward prediction errors

Neurons in the orbitofrontal cortex (OFC) fire in anticipation of and during rewards. Such firing has been suggested to encode reward predictions and to account in some way for the role of this area in adaptive behavior and learning. However, it has also been reported that neural activity in OFC ref...

Descripción completa

Detalles Bibliográficos
Autores principales: Stalnaker, Thomas A., Liu, Tzu-Lan, Takahashi, Yuji K., Schoenbaum, Geoffrey
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6136456/
https://www.ncbi.nlm.nih.gov/pubmed/29408053
http://dx.doi.org/10.1016/j.nlm.2018.01.013
_version_ 1783354999284170752
author Stalnaker, Thomas A.
Liu, Tzu-Lan
Takahashi, Yuji K.
Schoenbaum, Geoffrey
author_facet Stalnaker, Thomas A.
Liu, Tzu-Lan
Takahashi, Yuji K.
Schoenbaum, Geoffrey
author_sort Stalnaker, Thomas A.
collection PubMed
description Neurons in the orbitofrontal cortex (OFC) fire in anticipation of and during rewards. Such firing has been suggested to encode reward predictions and to account in some way for the role of this area in adaptive behavior and learning. However, it has also been reported that neural activity in OFC reflects reward prediction errors, which might drive learning directly. Here we tested this question by analyzing the firing of OFC neurons recorded in an odor discrimination task in which rats were trained to sample odor cues and respond left or right on each trial for reward. Neurons were recorded across blocks of trials in which we switched either the number or the flavor of the reward delivered in each well. Previously we have described how neurons in this dataset fired to the predictive cues (Stalnaker et al., 2014); here we focused on the firing in anticipation of and just after delivery of each drop of reward, looking specifically for differences in firing based on whether the reward number or flavor was unexpected or expected. Unlike dopamine neurons recorded in this setting, which exhibited phasic error-like responses after surprising changes in either reward number or reward flavor (Takahashi et al., 2017), OFC neurons showed no such error correlates and instead fired in a way that reflected reward predictions.
format Online
Article
Text
id pubmed-6136456
institution National Center for Biotechnology Information
language English
publishDate 2018
record_format MEDLINE/PubMed
spelling pubmed-61364562018-09-13 Orbitofrontal neurons signal reward predictions, not reward prediction errors Stalnaker, Thomas A. Liu, Tzu-Lan Takahashi, Yuji K. Schoenbaum, Geoffrey Neurobiol Learn Mem Article Neurons in the orbitofrontal cortex (OFC) fire in anticipation of and during rewards. Such firing has been suggested to encode reward predictions and to account in some way for the role of this area in adaptive behavior and learning. However, it has also been reported that neural activity in OFC reflects reward prediction errors, which might drive learning directly. Here we tested this question by analyzing the firing of OFC neurons recorded in an odor discrimination task in which rats were trained to sample odor cues and respond left or right on each trial for reward. Neurons were recorded across blocks of trials in which we switched either the number or the flavor of the reward delivered in each well. Previously we have described how neurons in this dataset fired to the predictive cues (Stalnaker et al., 2014); here we focused on the firing in anticipation of and just after delivery of each drop of reward, looking specifically for differences in firing based on whether the reward number or flavor was unexpected or expected. Unlike dopamine neurons recorded in this setting, which exhibited phasic error-like responses after surprising changes in either reward number or reward flavor (Takahashi et al., 2017), OFC neurons showed no such error correlates and instead fired in a way that reflected reward predictions. 2018-01-31 2018-09 /pmc/articles/PMC6136456/ /pubmed/29408053 http://dx.doi.org/10.1016/j.nlm.2018.01.013 Text en https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/BY/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Stalnaker, Thomas A.
Liu, Tzu-Lan
Takahashi, Yuji K.
Schoenbaum, Geoffrey
Orbitofrontal neurons signal reward predictions, not reward prediction errors
title Orbitofrontal neurons signal reward predictions, not reward prediction errors
title_full Orbitofrontal neurons signal reward predictions, not reward prediction errors
title_fullStr Orbitofrontal neurons signal reward predictions, not reward prediction errors
title_full_unstemmed Orbitofrontal neurons signal reward predictions, not reward prediction errors
title_short Orbitofrontal neurons signal reward predictions, not reward prediction errors
title_sort orbitofrontal neurons signal reward predictions, not reward prediction errors
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6136456/
https://www.ncbi.nlm.nih.gov/pubmed/29408053
http://dx.doi.org/10.1016/j.nlm.2018.01.013
work_keys_str_mv AT stalnakerthomasa orbitofrontalneuronssignalrewardpredictionsnotrewardpredictionerrors
AT liutzulan orbitofrontalneuronssignalrewardpredictionsnotrewardpredictionerrors
AT takahashiyujik orbitofrontalneuronssignalrewardpredictionsnotrewardpredictionerrors
AT schoenbaumgeoffrey orbitofrontalneuronssignalrewardpredictionsnotrewardpredictionerrors