Cargando…

Catecholaminergic Regulation of Learning Rate in a Dynamic Environment

Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning...

Descripción completa

Detalles Bibliográficos
Autores principales: Jepma, Marieke, Murphy, Peter R., Nassar, Matthew R., Rangel-Gomez, Mauricio, Meeter, Martijn, Nieuwenhuis, Sander
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5085041/
https://www.ncbi.nlm.nih.gov/pubmed/27792728
http://dx.doi.org/10.1371/journal.pcbi.1005171
_version_ 1782463491759669248
author Jepma, Marieke
Murphy, Peter R.
Nassar, Matthew R.
Rangel-Gomez, Mauricio
Meeter, Martijn
Nieuwenhuis, Sander
author_facet Jepma, Marieke
Murphy, Peter R.
Nassar, Matthew R.
Rangel-Gomez, Mauricio
Meeter, Martijn
Nieuwenhuis, Sander
author_sort Jepma, Marieke
collection PubMed
description Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning rate’). However, the brain mechanisms, and in particular the neuromodulators, involved in this process are still largely unknown. The brain-wide neurophysiological effects of the catecholamines norepinephrine and dopamine on stimulus-evoked cortical responses suggest that the catecholamine systems are well positioned to regulate learning about environmental change, but more direct evidence for a role of this system is scant. Here, we report evidence from a study employing pharmacology, scalp electrophysiology and computational modeling (N = 32) that suggests an important role for catecholamines in learning rate regulation. We found that the P3 component of the EEG—an electrophysiological index of outcome-evoked phasic catecholamine release in the cortex—predicted learning rate, and formally mediated the effect of prediction-error magnitude on learning rate. P3 amplitude also mediated the effects of two computational variables—capturing the unexpectedness of an outcome and the uncertainty of a preexisting belief—on learning rate. Furthermore, a pharmacological manipulation of catecholamine activity affected learning rate following unanticipated task changes, in a way that depended on participants’ baseline learning rate. Our findings provide converging evidence for a causal role of the human catecholamine systems in learning-rate regulation as a function of environmental change.
format Online
Article
Text
id pubmed-5085041
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-50850412016-11-04 Catecholaminergic Regulation of Learning Rate in a Dynamic Environment Jepma, Marieke Murphy, Peter R. Nassar, Matthew R. Rangel-Gomez, Mauricio Meeter, Martijn Nieuwenhuis, Sander PLoS Comput Biol Research Article Adaptive behavior in a changing world requires flexibly adapting one’s rate of learning to the rate of environmental change. Recent studies have examined the computational mechanisms by which various environmental factors determine the impact of new outcomes on existing beliefs (i.e., the ‘learning rate’). However, the brain mechanisms, and in particular the neuromodulators, involved in this process are still largely unknown. The brain-wide neurophysiological effects of the catecholamines norepinephrine and dopamine on stimulus-evoked cortical responses suggest that the catecholamine systems are well positioned to regulate learning about environmental change, but more direct evidence for a role of this system is scant. Here, we report evidence from a study employing pharmacology, scalp electrophysiology and computational modeling (N = 32) that suggests an important role for catecholamines in learning rate regulation. We found that the P3 component of the EEG—an electrophysiological index of outcome-evoked phasic catecholamine release in the cortex—predicted learning rate, and formally mediated the effect of prediction-error magnitude on learning rate. P3 amplitude also mediated the effects of two computational variables—capturing the unexpectedness of an outcome and the uncertainty of a preexisting belief—on learning rate. Furthermore, a pharmacological manipulation of catecholamine activity affected learning rate following unanticipated task changes, in a way that depended on participants’ baseline learning rate. Our findings provide converging evidence for a causal role of the human catecholamine systems in learning-rate regulation as a function of environmental change. Public Library of Science 2016-10-28 /pmc/articles/PMC5085041/ /pubmed/27792728 http://dx.doi.org/10.1371/journal.pcbi.1005171 Text en © 2016 Jepma et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Jepma, Marieke
Murphy, Peter R.
Nassar, Matthew R.
Rangel-Gomez, Mauricio
Meeter, Martijn
Nieuwenhuis, Sander
Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title_full Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title_fullStr Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title_full_unstemmed Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title_short Catecholaminergic Regulation of Learning Rate in a Dynamic Environment
title_sort catecholaminergic regulation of learning rate in a dynamic environment
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5085041/
https://www.ncbi.nlm.nih.gov/pubmed/27792728
http://dx.doi.org/10.1371/journal.pcbi.1005171
work_keys_str_mv AT jepmamarieke catecholaminergicregulationoflearningrateinadynamicenvironment
AT murphypeterr catecholaminergicregulationoflearningrateinadynamicenvironment
AT nassarmatthewr catecholaminergicregulationoflearningrateinadynamicenvironment
AT rangelgomezmauricio catecholaminergicregulationoflearningrateinadynamicenvironment
AT meetermartijn catecholaminergicregulationoflearningrateinadynamicenvironment
AT nieuwenhuissander catecholaminergicregulationoflearningrateinadynamicenvironment