Cargando…

Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model

The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC respons...

Descripción completa

Detalles Bibliográficos
Autores principales: Sales, Anna C., Friston, Karl J., Jones, Matthew W., Pickering, Anthony E., Moran, Rosalyn J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6334975/
https://www.ncbi.nlm.nih.gov/pubmed/30608922
http://dx.doi.org/10.1371/journal.pcbi.1006267
_version_ 1783387822204387328
author Sales, Anna C.
Friston, Karl J.
Jones, Matthew W.
Pickering, Anthony E.
Moran, Rosalyn J.
author_facet Sales, Anna C.
Friston, Karl J.
Jones, Matthew W.
Pickering, Anthony E.
Moran, Rosalyn J.
author_sort Sales, Anna C.
collection PubMed
description The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm ‘explore/exploit’ task and show that, if LC activity is considered to reflect the magnitude of high level ‘state-action’ prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error–reflected in LC firing and noradrenaline release–to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability.
format Online
Article
Text
id pubmed-6334975
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-63349752019-01-30 Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model Sales, Anna C. Friston, Karl J. Jones, Matthew W. Pickering, Anthony E. Moran, Rosalyn J. PLoS Comput Biol Research Article The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm ‘explore/exploit’ task and show that, if LC activity is considered to reflect the magnitude of high level ‘state-action’ prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error–reflected in LC firing and noradrenaline release–to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability. Public Library of Science 2019-01-04 /pmc/articles/PMC6334975/ /pubmed/30608922 http://dx.doi.org/10.1371/journal.pcbi.1006267 Text en © 2019 Sales et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Sales, Anna C.
Friston, Karl J.
Jones, Matthew W.
Pickering, Anthony E.
Moran, Rosalyn J.
Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title_full Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title_fullStr Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title_full_unstemmed Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title_short Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
title_sort locus coeruleus tracking of prediction errors optimises cognitive flexibility: an active inference model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6334975/
https://www.ncbi.nlm.nih.gov/pubmed/30608922
http://dx.doi.org/10.1371/journal.pcbi.1006267
work_keys_str_mv AT salesannac locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel
AT fristonkarlj locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel
AT jonesmattheww locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel
AT pickeringanthonye locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel
AT moranrosalynj locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel