Cargando…

The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection

Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We...

Descripción completa

Detalles Bibliográficos
Autores principales: Akam, Thomas, Rodrigues-Vaz, Ines, Marcelo, Ivo, Zhang, Xiangyu, Pereira, Michael, Oliveira, Rodrigo Freire, Dayan, Peter, Costa, Rui M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cell Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7837117/
https://www.ncbi.nlm.nih.gov/pubmed/33152266
http://dx.doi.org/10.1016/j.neuron.2020.10.013
_version_ 1783642894286979072
author Akam, Thomas
Rodrigues-Vaz, Ines
Marcelo, Ivo
Zhang, Xiangyu
Pereira, Michael
Oliveira, Rodrigo Freire
Dayan, Peter
Costa, Rui M.
author_facet Akam, Thomas
Rodrigues-Vaz, Ines
Marcelo, Ivo
Zhang, Xiangyu
Pereira, Michael
Oliveira, Rodrigo Freire
Dayan, Peter
Costa, Rui M.
author_sort Akam, Thomas
collection PubMed
description Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions.
format Online
Article
Text
id pubmed-7837117
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Cell Press
record_format MEDLINE/PubMed
spelling pubmed-78371172021-02-01 The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection Akam, Thomas Rodrigues-Vaz, Ines Marcelo, Ivo Zhang, Xiangyu Pereira, Michael Oliveira, Rodrigo Freire Dayan, Peter Costa, Rui M. Neuron Article Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions. Cell Press 2021-01-06 /pmc/articles/PMC7837117/ /pubmed/33152266 http://dx.doi.org/10.1016/j.neuron.2020.10.013 Text en © 2020 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Akam, Thomas
Rodrigues-Vaz, Ines
Marcelo, Ivo
Zhang, Xiangyu
Pereira, Michael
Oliveira, Rodrigo Freire
Dayan, Peter
Costa, Rui M.
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title_full The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title_fullStr The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title_full_unstemmed The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title_short The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
title_sort anterior cingulate cortex predicts future states to mediate model-based action selection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7837117/
https://www.ncbi.nlm.nih.gov/pubmed/33152266
http://dx.doi.org/10.1016/j.neuron.2020.10.013
work_keys_str_mv AT akamthomas theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT rodriguesvazines theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT marceloivo theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT zhangxiangyu theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT pereiramichael theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT oliveirarodrigofreire theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT dayanpeter theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT costaruim theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT akamthomas anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT rodriguesvazines anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT marceloivo anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT zhangxiangyu anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT pereiramichael anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT oliveirarodrigofreire anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT dayanpeter anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection
AT costaruim anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection