Cargando…
Dark control: The default mode network as a reinforcement learning agent
The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley & Sons, Inc.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7375062/ https://www.ncbi.nlm.nih.gov/pubmed/32500968 http://dx.doi.org/10.1002/hbm.25019 |
_version_ | 1783561809336205312 |
---|---|
author | Dohmatob, Elvis Dumas, Guillaume Bzdok, Danilo |
author_facet | Dohmatob, Elvis Dumas, Guillaume Bzdok, Danilo |
author_sort | Dohmatob, Elvis |
collection | PubMed |
description | The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans. |
format | Online Article Text |
id | pubmed-7375062 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | John Wiley & Sons, Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-73750622020-07-22 Dark control: The default mode network as a reinforcement learning agent Dohmatob, Elvis Dumas, Guillaume Bzdok, Danilo Hum Brain Mapp Research Articles The default mode network (DMN) is believed to subserve the baseline mental activity in humans. Its higher energy consumption compared to other brain networks and its intimate coupling with conscious awareness are both pointing to an unknown overarching function. Many research streams speak in favor of an evolutionarily adaptive role in envisioning experience to anticipate the future. In the present work, we propose a process model that tries to explain how the DMN may implement continuous evaluation and prediction of the environment to guide behavior. The main purpose of DMN activity, we argue, may be described by Markov decision processes that optimize action policies via value estimates through vicarious trial and error. Our formal perspective on DMN function naturally accommodates as special cases previous interpretations based on (a) predictive coding, (b) semantic associations, and (c) a sentinel role. Moreover, this process model for the neural optimization of complex behavior in the DMN offers parsimonious explanations for recent experimental findings in animals and humans. John Wiley & Sons, Inc. 2020-06-05 /pmc/articles/PMC7375062/ /pubmed/32500968 http://dx.doi.org/10.1002/hbm.25019 Text en © 2020 The Authors. Human Brain Mapping published by Wiley Periodicals, Inc. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Articles Dohmatob, Elvis Dumas, Guillaume Bzdok, Danilo Dark control: The default mode network as a reinforcement learning agent |
title | Dark control: The default mode network as a reinforcement learning agent |
title_full | Dark control: The default mode network as a reinforcement learning agent |
title_fullStr | Dark control: The default mode network as a reinforcement learning agent |
title_full_unstemmed | Dark control: The default mode network as a reinforcement learning agent |
title_short | Dark control: The default mode network as a reinforcement learning agent |
title_sort | dark control: the default mode network as a reinforcement learning agent |
topic | Research Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7375062/ https://www.ncbi.nlm.nih.gov/pubmed/32500968 http://dx.doi.org/10.1002/hbm.25019 |
work_keys_str_mv | AT dohmatobelvis darkcontrolthedefaultmodenetworkasareinforcementlearningagent AT dumasguillaume darkcontrolthedefaultmodenetworkasareinforcementlearningagent AT bzdokdanilo darkcontrolthedefaultmodenetworkasareinforcementlearningagent |