Cargando…
The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection
Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cell Press
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7837117/ https://www.ncbi.nlm.nih.gov/pubmed/33152266 http://dx.doi.org/10.1016/j.neuron.2020.10.013 |
_version_ | 1783642894286979072 |
---|---|
author | Akam, Thomas Rodrigues-Vaz, Ines Marcelo, Ivo Zhang, Xiangyu Pereira, Michael Oliveira, Rodrigo Freire Dayan, Peter Costa, Rui M. |
author_facet | Akam, Thomas Rodrigues-Vaz, Ines Marcelo, Ivo Zhang, Xiangyu Pereira, Michael Oliveira, Rodrigo Freire Dayan, Peter Costa, Rui M. |
author_sort | Akam, Thomas |
collection | PubMed |
description | Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions. |
format | Online Article Text |
id | pubmed-7837117 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Cell Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-78371172021-02-01 The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection Akam, Thomas Rodrigues-Vaz, Ines Marcelo, Ivo Zhang, Xiangyu Pereira, Michael Oliveira, Rodrigo Freire Dayan, Peter Costa, Rui M. Neuron Article Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions. Cell Press 2021-01-06 /pmc/articles/PMC7837117/ /pubmed/33152266 http://dx.doi.org/10.1016/j.neuron.2020.10.013 Text en © 2020 The Authors http://creativecommons.org/licenses/by/4.0/ This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Akam, Thomas Rodrigues-Vaz, Ines Marcelo, Ivo Zhang, Xiangyu Pereira, Michael Oliveira, Rodrigo Freire Dayan, Peter Costa, Rui M. The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title | The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title_full | The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title_fullStr | The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title_full_unstemmed | The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title_short | The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection |
title_sort | anterior cingulate cortex predicts future states to mediate model-based action selection |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7837117/ https://www.ncbi.nlm.nih.gov/pubmed/33152266 http://dx.doi.org/10.1016/j.neuron.2020.10.013 |
work_keys_str_mv | AT akamthomas theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT rodriguesvazines theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT marceloivo theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT zhangxiangyu theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT pereiramichael theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT oliveirarodrigofreire theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT dayanpeter theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT costaruim theanteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT akamthomas anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT rodriguesvazines anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT marceloivo anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT zhangxiangyu anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT pereiramichael anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT oliveirarodrigofreire anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT dayanpeter anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection AT costaruim anteriorcingulatecortexpredictsfuturestatestomediatemodelbasedactionselection |