Cargando…
Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model
The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC respons...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6334975/ https://www.ncbi.nlm.nih.gov/pubmed/30608922 http://dx.doi.org/10.1371/journal.pcbi.1006267 |
_version_ | 1783387822204387328 |
---|---|
author | Sales, Anna C. Friston, Karl J. Jones, Matthew W. Pickering, Anthony E. Moran, Rosalyn J. |
author_facet | Sales, Anna C. Friston, Karl J. Jones, Matthew W. Pickering, Anthony E. Moran, Rosalyn J. |
author_sort | Sales, Anna C. |
collection | PubMed |
description | The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm ‘explore/exploit’ task and show that, if LC activity is considered to reflect the magnitude of high level ‘state-action’ prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error–reflected in LC firing and noradrenaline release–to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability. |
format | Online Article Text |
id | pubmed-6334975 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-63349752019-01-30 Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model Sales, Anna C. Friston, Karl J. Jones, Matthew W. Pickering, Anthony E. Moran, Rosalyn J. PLoS Comput Biol Research Article The locus coeruleus (LC) in the pons is the major source of noradrenaline (NA) in the brain. Two modes of LC firing have been associated with distinct cognitive states: changes in tonic rates of firing are correlated with global levels of arousal and behavioural flexibility, whilst phasic LC responses are evoked by salient stimuli. Here, we unify these two modes of firing by modelling the response of the LC as a correlate of a prediction error when inferring states for action planning under Active Inference (AI). We simulate a classic Go/No-go reward learning task and a three-arm ‘explore/exploit’ task and show that, if LC activity is considered to reflect the magnitude of high level ‘state-action’ prediction errors, then both tonic and phasic modes of firing are emergent features of belief updating. We also demonstrate that when contingencies change, AI agents can update their internal models more quickly by feeding back this state-action prediction error–reflected in LC firing and noradrenaline release–to optimise learning rate, enabling large adjustments over short timescales. We propose that such prediction errors are mediated by cortico-LC connections, whilst ascending input from LC to cortex modulates belief updating in anterior cingulate cortex (ACC). In short, we characterise the LC/ NA system within a general theory of brain function. In doing so, we show that contrasting, behaviour-dependent firing patterns are an emergent property of the LC that translates state-action prediction errors into an optimal balance between plasticity and stability. Public Library of Science 2019-01-04 /pmc/articles/PMC6334975/ /pubmed/30608922 http://dx.doi.org/10.1371/journal.pcbi.1006267 Text en © 2019 Sales et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Sales, Anna C. Friston, Karl J. Jones, Matthew W. Pickering, Anthony E. Moran, Rosalyn J. Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title | Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title_full | Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title_fullStr | Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title_full_unstemmed | Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title_short | Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model |
title_sort | locus coeruleus tracking of prediction errors optimises cognitive flexibility: an active inference model |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6334975/ https://www.ncbi.nlm.nih.gov/pubmed/30608922 http://dx.doi.org/10.1371/journal.pcbi.1006267 |
work_keys_str_mv | AT salesannac locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel AT fristonkarlj locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel AT jonesmattheww locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel AT pickeringanthonye locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel AT moranrosalynj locuscoeruleustrackingofpredictionerrorsoptimisescognitiveflexibilityanactiveinferencemodel |