Cargando…
Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5085041/ https://www.ncbi.nlm.nih.gov/pubmed/27792728 http://dx.doi.org/10.1371/journal.pcbi.1005171 |
_version_ | 1782463491759669248 |
---|---|
author | Jepma, Marieke Murphy, Peter R. Nassar, Matthew R. Rangel-Gomez, Mauricio Meeter, Martijn Nieuwenhuis, Sander |
author_facet | Jepma, Marieke Murphy, Peter R. Nassar, Matthew R. Rangel-Gomez, Mauricio Meeter, Martijn Nieuwenhuis, Sander |
author_sort | Jepma, Marieke |
collection | PubMed |
description | Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning rate’). However, the brain mechanisms, and in particular the neuromodulators, involved in this process are still largely unknown. The brain-wide neurophysiological effects of the catecholamines norepinephrine and dopamine on stimulus-evoked cortical responses suggest that the catecholamine systems are well positioned to regulate learning about environmental change, but more direct evidence for a role of this system is scant. Here, we report evidence from a study employing pharmacology, scalp electrophysiology and computational modeling (N = 32) that suggests an important role for catecholamines in learning rate regulation. We found that the P3 component of the EEG—an electrophysiological index of outcome-evoked phasic catecholamine release in the cortex—predicted learning rate, and formally mediated the effect of prediction-error magnitude on learning rate. P3 amplitude also mediated the effects of two computational variables—capturing the unexpectedness of an outcome and the uncertainty of a preexisting belief—on learning rate. Furthermore, a pharmacological manipulation of catecholamine activity affected learning rate following unanticipated task changes, in a way that depended on participants’ baseline learning rate. Our findings provide converging evidence for a causal role of the human catecholamine systems in learning-rate regulation as a function of environmental change. |
format | Online Article Text |
id | pubmed-5085041 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-50850412016-11-04 Catecholaminergic Regulation of Learning Rate in a Dynamic Environment Jepma, Marieke Murphy, Peter R. Nassar, Matthew R. Rangel-Gomez, Mauricio Meeter, Martijn Nieuwenhuis, Sander PLoS Comput Biol Research Article Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning rate’). However, the brain mechanisms, and in particular the neuromodulators, involved in this process are still largely unknown. The brain-wide neurophysiological effects of the catecholamines norepinephrine and dopamine on stimulus-evoked cortical responses suggest that the catecholamine systems are well positioned to regulate learning about environmental change, but more direct evidence for a role of this system is scant. Here, we report evidence from a study employing pharmacology, scalp electrophysiology and computational modeling (N = 32) that suggests an important role for catecholamines in learning rate regulation. We found that the P3 component of the EEG—an electrophysiological index of outcome-evoked phasic catecholamine release in the cortex—predicted learning rate, and formally mediated the effect of prediction-error magnitude on learning rate. P3 amplitude also mediated the effects of two computational variables—capturing the unexpectedness of an outcome and the uncertainty of a preexisting belief—on learning rate. Furthermore, a pharmacological manipulation of catecholamine activity affected learning rate following unanticipated task changes, in a way that depended on participants’ baseline learning rate. Our findings provide converging evidence for a causal role of the human catecholamine systems in learning-rate regulation as a function of environmental change. Public Library of Science 2016-10-28 /pmc/articles/PMC5085041/ /pubmed/27792728 http://dx.doi.org/10.1371/journal.pcbi.1005171 Text en © 2016 Jepma et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Jepma, Marieke Murphy, Peter R. Nassar, Matthew R. Rangel-Gomez, Mauricio Meeter, Martijn Nieuwenhuis, Sander Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title | Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title_full | Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title_fullStr | Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title_full_unstemmed | Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title_short | Catecholaminergic Regulation of Learning Rate in a Dynamic Environment |
title_sort | catecholaminergic regulation of learning rate in a dynamic environment |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5085041/ https://www.ncbi.nlm.nih.gov/pubmed/27792728 http://dx.doi.org/10.1371/journal.pcbi.1005171 |
work_keys_str_mv | AT jepmamarieke catecholaminergicregulationoflearningrateinadynamicenvironment AT murphypeterr catecholaminergicregulationoflearningrateinadynamicenvironment AT nassarmatthewr catecholaminergicregulationoflearningrateinadynamicenvironment AT rangelgomezmauricio catecholaminergicregulationoflearningrateinadynamicenvironment AT meetermartijn catecholaminergicregulationoflearningrateinadynamicenvironment AT nieuwenhuissander catecholaminergicregulationoflearningrateinadynamicenvironment |