Cargando…

Dark control: The default mode network as a reinforcement learning agent

The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor...

Descripción completa

Detalles Bibliográficos
Autores principales: Dohmatob, Elvis, Dumas, Guillaume, Bzdok, Danilo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley & Sons, Inc. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7375062/
https://www.ncbi.nlm.nih.gov/pubmed/32500968
http://dx.doi.org/10.1002/hbm.25019
_version_ 1783561809336205312
author Dohmatob, Elvis
Dumas, Guillaume
Bzdok, Danilo
author_facet Dohmatob, Elvis
Dumas, Guillaume
Bzdok, Danilo
author_sort Dohmatob, Elvis
collection PubMed
description The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans.
format Online
Article
Text
id pubmed-7375062
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher John Wiley & Sons, Inc.
record_format MEDLINE/PubMed
spelling pubmed-73750622020-07-22 Dark control: The default mode network as a reinforcement learning agent Dohmatob, Elvis Dumas, Guillaume Bzdok, Danilo Hum Brain Mapp Research Articles The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans. John Wiley & Sons, Inc. 2020-06-05 /pmc/articles/PMC7375062/ /pubmed/32500968 http://dx.doi.org/10.1002/hbm.25019 Text en © 2020 The Authors. Human Brain Mapping published by Wiley Periodicals, Inc. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Articles
Dohmatob, Elvis
Dumas, Guillaume
Bzdok, Danilo
Dark control: The default mode network as a reinforcement learning agent
title Dark control: The default mode network as a reinforcement learning agent
title_full Dark control: The default mode network as a reinforcement learning agent
title_fullStr Dark control: The default mode network as a reinforcement learning agent
title_full_unstemmed Dark control: The default mode network as a reinforcement learning agent
title_short Dark control: The default mode network as a reinforcement learning agent
title_sort dark control: the default mode network as a reinforcement learning agent
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7375062/
https://www.ncbi.nlm.nih.gov/pubmed/32500968
http://dx.doi.org/10.1002/hbm.25019
work_keys_str_mv AT dohmatobelvis darkcontrolthedefaultmodenetworkasareinforcementlearningagent
AT dumasguillaume darkcontrolthedefaultmodenetworkasareinforcementlearningagent
AT bzdokdanilo darkcontrolthedefaultmodenetworkasareinforcementlearningagent