Cargando…

Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency

Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participant...

Descripción completa

Detalles Bibliográficos
Autores principales: Diederen, Kelly M.J., Spencer, Tom, Vestergaard, Martin D., Fletcher, Paul C., Schultz, Wolfram
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cell Press 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4893165/
https://www.ncbi.nlm.nih.gov/pubmed/27181060
http://dx.doi.org/10.1016/j.neuron.2016.04.019
_version_ 1782435507992526848
author Diederen, Kelly M.J.
Spencer, Tom
Vestergaard, Martin D.
Fletcher, Paul C.
Schultz, Wolfram
author_facet Diederen, Kelly M.J.
Spencer, Tom
Vestergaard, Martin D.
Fletcher, Paul C.
Schultz, Wolfram
author_sort Diederen, Kelly M.J.
collection PubMed
description Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning.
format Online
Article
Text
id pubmed-4893165
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Cell Press
record_format MEDLINE/PubMed
spelling pubmed-48931652016-06-13 Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency Diederen, Kelly M.J. Spencer, Tom Vestergaard, Martin D. Fletcher, Paul C. Schultz, Wolfram Neuron Article Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning. Cell Press 2016-06-01 /pmc/articles/PMC4893165/ /pubmed/27181060 http://dx.doi.org/10.1016/j.neuron.2016.04.019 Text en © 2016 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Diederen, Kelly M.J.
Spencer, Tom
Vestergaard, Martin D.
Fletcher, Paul C.
Schultz, Wolfram
Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title_full Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title_fullStr Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title_full_unstemmed Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title_short Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
title_sort adaptive prediction error coding in the human midbrain and striatum facilitates behavioral adaptation and learning efficiency
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4893165/
https://www.ncbi.nlm.nih.gov/pubmed/27181060
http://dx.doi.org/10.1016/j.neuron.2016.04.019
work_keys_str_mv AT diederenkellymj adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency
AT spencertom adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency
AT vestergaardmartind adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency
AT fletcherpaulc adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency
AT schultzwolfram adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency