Cargando…
Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency
Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participant...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cell Press
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4893165/ https://www.ncbi.nlm.nih.gov/pubmed/27181060 http://dx.doi.org/10.1016/j.neuron.2016.04.019 |
_version_ | 1782435507992526848 |
---|---|
author | Diederen, Kelly M.J. Spencer, Tom Vestergaard, Martin D. Fletcher, Paul C. Schultz, Wolfram |
author_facet | Diederen, Kelly M.J. Spencer, Tom Vestergaard, Martin D. Fletcher, Paul C. Schultz, Wolfram |
author_sort | Diederen, Kelly M.J. |
collection | PubMed |
description | Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning. |
format | Online Article Text |
id | pubmed-4893165 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Cell Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-48931652016-06-13 Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency Diederen, Kelly M.J. Spencer, Tom Vestergaard, Martin D. Fletcher, Paul C. Schultz, Wolfram Neuron Article Effective error-driven learning benefits from scaling of prediction errors to reward variability. Such behavioral adaptation may be facilitated by neurons coding prediction errors relative to the standard deviation (SD) of reward distributions. To investigate this hypothesis, we required participants to predict the magnitude of upcoming reward drawn from distributions with different SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. In line with the notion of adaptive coding, BOLD response slopes in the Substantia Nigra/Ventral Tegmental Area (SN/VTA) and ventral striatum were steeper for prediction errors occurring in distributions with smaller SDs. SN/VTA adaptation was not instantaneous but developed across trials. Adaptive prediction error coding was paralleled by behavioral adaptation, as reflected by SD-dependent changes in learning rate. Crucially, increased SN/VTA and ventral striatal adaptation was related to improved task performance. These results suggest that adaptive coding facilitates behavioral adaptation and supports efficient learning. Cell Press 2016-06-01 /pmc/articles/PMC4893165/ /pubmed/27181060 http://dx.doi.org/10.1016/j.neuron.2016.04.019 Text en © 2016 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Diederen, Kelly M.J. Spencer, Tom Vestergaard, Martin D. Fletcher, Paul C. Schultz, Wolfram Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title | Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title_full | Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title_fullStr | Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title_full_unstemmed | Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title_short | Adaptive Prediction Error Coding in the Human Midbrain and Striatum Facilitates Behavioral Adaptation and Learning Efficiency |
title_sort | adaptive prediction error coding in the human midbrain and striatum facilitates behavioral adaptation and learning efficiency |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4893165/ https://www.ncbi.nlm.nih.gov/pubmed/27181060 http://dx.doi.org/10.1016/j.neuron.2016.04.019 |
work_keys_str_mv | AT diederenkellymj adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency AT spencertom adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency AT vestergaardmartind adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency AT fletcherpaulc adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency AT schultzwolfram adaptivepredictionerrorcodinginthehumanmidbrainandstriatumfacilitatesbehavioraladaptationandlearningefficiency |