Cargando…

Observational learning computations in neurons of the human anterior cingulate cortex

When learning from direct experience, neurons in the primate brain have been shown to encode a teaching signal used by algorithms in artificial intelligence: the reward prediction error (PE)—the difference between how rewarding an event is, and how rewarding it was expected to be. However, in humans...

Descripción completa

Detalles Bibliográficos
Autores principales: Hill, Michael R., Boorman, Erie D., Fried, Itzhak
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5025858/
https://www.ncbi.nlm.nih.gov/pubmed/27598687
http://dx.doi.org/10.1038/ncomms12722
_version_ 1782454035110952960
author Hill, Michael R.
Boorman, Erie D.
Fried, Itzhak
author_facet Hill, Michael R.
Boorman, Erie D.
Fried, Itzhak
author_sort Hill, Michael R.
collection PubMed
description When learning from direct experience, neurons in the primate brain have been shown to encode a teaching signal used by algorithms in artificial intelligence: the reward prediction error (PE)—the difference between how rewarding an event is, and how rewarding it was expected to be. However, in humans and other species learning often takes place by observing other individuals. Here, we show that, when humans observe other players in a card game, neurons in their rostral anterior cingulate cortex (rACC) encode both the expected value of an observed choice, and the PE after the outcome was revealed. Notably, during the same task neurons recorded in the amygdala (AMY) and the rostromedial prefrontal cortex (rmPFC) do not exhibit this type of encoding. Our results suggest that humans learn by observing others, at least in part through the encoding of observational PEs in single neurons in the rACC.
format Online
Article
Text
id pubmed-5025858
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Nature Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-50258582016-09-23 Observational learning computations in neurons of the human anterior cingulate cortex Hill, Michael R. Boorman, Erie D. Fried, Itzhak Nat Commun Article When learning from direct experience, neurons in the primate brain have been shown to encode a teaching signal used by algorithms in artificial intelligence: the reward prediction error (PE)—the difference between how rewarding an event is, and how rewarding it was expected to be. However, in humans and other species learning often takes place by observing other individuals. Here, we show that, when humans observe other players in a card game, neurons in their rostral anterior cingulate cortex (rACC) encode both the expected value of an observed choice, and the PE after the outcome was revealed. Notably, during the same task neurons recorded in the amygdala (AMY) and the rostromedial prefrontal cortex (rmPFC) do not exhibit this type of encoding. Our results suggest that humans learn by observing others, at least in part through the encoding of observational PEs in single neurons in the rACC. Nature Publishing Group 2016-09-06 /pmc/articles/PMC5025858/ /pubmed/27598687 http://dx.doi.org/10.1038/ncomms12722 Text en Copyright © 2016, The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article's Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Hill, Michael R.
Boorman, Erie D.
Fried, Itzhak
Observational learning computations in neurons of the human anterior cingulate cortex
title Observational learning computations in neurons of the human anterior cingulate cortex
title_full Observational learning computations in neurons of the human anterior cingulate cortex
title_fullStr Observational learning computations in neurons of the human anterior cingulate cortex
title_full_unstemmed Observational learning computations in neurons of the human anterior cingulate cortex
title_short Observational learning computations in neurons of the human anterior cingulate cortex
title_sort observational learning computations in neurons of the human anterior cingulate cortex
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5025858/
https://www.ncbi.nlm.nih.gov/pubmed/27598687
http://dx.doi.org/10.1038/ncomms12722
work_keys_str_mv AT hillmichaelr observationallearningcomputationsinneuronsofthehumananteriorcingulatecortex
AT boormaneried observationallearningcomputationsinneuronsofthehumananteriorcingulatecortex
AT frieditzhak observationallearningcomputationsinneuronsofthehumananteriorcingulatecortex