Cargando…

Dopamine, Affordance and Active Inference

The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or sal...

Descripción completa

Detalles Bibliográficos
Autores principales: Friston, Karl J., Shiner, Tamara, FitzGerald, Thomas, Galea, Joseph M., Adams, Rick, Brown, Harriet, Dolan, Raymond J., Moran, Rosalyn, Stephan, Klaas Enno, Bestmann, Sven
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2012
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3252266/
https://www.ncbi.nlm.nih.gov/pubmed/22241972
http://dx.doi.org/10.1371/journal.pcbi.1002327
_version_ 1782220609273462784
author Friston, Karl J.
Shiner, Tamara
FitzGerald, Thomas
Galea, Joseph M.
Adams, Rick
Brown, Harriet
Dolan, Raymond J.
Moran, Rosalyn
Stephan, Klaas Enno
Bestmann, Sven
author_facet Friston, Karl J.
Shiner, Tamara
FitzGerald, Thomas
Galea, Joseph M.
Adams, Rick
Brown, Harriet
Dolan, Raymond J.
Moran, Rosalyn
Stephan, Klaas Enno
Bestmann, Sven
author_sort Friston, Karl J.
collection PubMed
description The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level.
format Online
Article
Text
id pubmed-3252266
institution National Center for Biotechnology Information
language English
publishDate 2012
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-32522662012-01-12 Dopamine, Affordance and Active Inference Friston, Karl J. Shiner, Tamara FitzGerald, Thomas Galea, Joseph M. Adams, Rick Brown, Harriet Dolan, Raymond J. Moran, Rosalyn Stephan, Klaas Enno Bestmann, Sven PLoS Comput Biol Research Article The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level. Public Library of Science 2012-01-05 /pmc/articles/PMC3252266/ /pubmed/22241972 http://dx.doi.org/10.1371/journal.pcbi.1002327 Text en Friston et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Friston, Karl J.
Shiner, Tamara
FitzGerald, Thomas
Galea, Joseph M.
Adams, Rick
Brown, Harriet
Dolan, Raymond J.
Moran, Rosalyn
Stephan, Klaas Enno
Bestmann, Sven
Dopamine, Affordance and Active Inference
title Dopamine, Affordance and Active Inference
title_full Dopamine, Affordance and Active Inference
title_fullStr Dopamine, Affordance and Active Inference
title_full_unstemmed Dopamine, Affordance and Active Inference
title_short Dopamine, Affordance and Active Inference
title_sort dopamine, affordance and active inference
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3252266/
https://www.ncbi.nlm.nih.gov/pubmed/22241972
http://dx.doi.org/10.1371/journal.pcbi.1002327
work_keys_str_mv AT fristonkarlj dopamineaffordanceandactiveinference
AT shinertamara dopamineaffordanceandactiveinference
AT fitzgeraldthomas dopamineaffordanceandactiveinference
AT galeajosephm dopamineaffordanceandactiveinference
AT adamsrick dopamineaffordanceandactiveinference
AT brownharriet dopamineaffordanceandactiveinference
AT dolanraymondj dopamineaffordanceandactiveinference
AT moranrosalyn dopamineaffordanceandactiveinference
AT stephanklaasenno dopamineaffordanceandactiveinference
AT bestmannsven dopamineaffordanceandactiveinference