Cargando…

Confidence resets reveal hierarchical adaptive learning in humans

Hierarchical processing is pervasive in the brain, but its computational significance for learning under uncertainty is disputed. On the one hand, hierarchical models provide an optimal framework and are becoming increasingly popular to study cognition. On the other hand, non-hierarchical (flat) mod...

Descripción completa

Detalles Bibliográficos
Autores principales: Heilbron, Micha, Meyniel, Florent
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6474633/
https://www.ncbi.nlm.nih.gov/pubmed/30964861
http://dx.doi.org/10.1371/journal.pcbi.1006972
_version_ 1783412640233553920
author Heilbron, Micha
Meyniel, Florent
author_facet Heilbron, Micha
Meyniel, Florent
author_sort Heilbron, Micha
collection PubMed
description Hierarchical processing is pervasive in the brain, but its computational significance for learning under uncertainty is disputed. On the one hand, hierarchical models provide an optimal framework and are becoming increasingly popular to study cognition. On the other hand, non-hierarchical (flat) models remain influential and can learn efficiently, even in uncertain and changing environments. Here, we show that previously proposed hallmarks of hierarchical learning, which relied on reports of learned quantities or choices in simple experiments, are insufficient to categorically distinguish hierarchical from flat models. Instead, we present a novel test which leverages a more complex task, whose hierarchical structure allows generalization between different statistics tracked in parallel. We use reports of confidence to quantitatively and qualitatively arbitrate between the two accounts of learning. Our results support the hierarchical learning framework, and demonstrate how confidence can be a useful metric in learning theory.
format Online
Article
Text
id pubmed-6474633
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-64746332019-05-03 Confidence resets reveal hierarchical adaptive learning in humans Heilbron, Micha Meyniel, Florent PLoS Comput Biol Research Article Hierarchical processing is pervasive in the brain, but its computational significance for learning under uncertainty is disputed. On the one hand, hierarchical models provide an optimal framework and are becoming increasingly popular to study cognition. On the other hand, non-hierarchical (flat) models remain influential and can learn efficiently, even in uncertain and changing environments. Here, we show that previously proposed hallmarks of hierarchical learning, which relied on reports of learned quantities or choices in simple experiments, are insufficient to categorically distinguish hierarchical from flat models. Instead, we present a novel test which leverages a more complex task, whose hierarchical structure allows generalization between different statistics tracked in parallel. We use reports of confidence to quantitatively and qualitatively arbitrate between the two accounts of learning. Our results support the hierarchical learning framework, and demonstrate how confidence can be a useful metric in learning theory. Public Library of Science 2019-04-09 /pmc/articles/PMC6474633/ /pubmed/30964861 http://dx.doi.org/10.1371/journal.pcbi.1006972 Text en © 2019 Heilbron, Meyniel http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Heilbron, Micha
Meyniel, Florent
Confidence resets reveal hierarchical adaptive learning in humans
title Confidence resets reveal hierarchical adaptive learning in humans
title_full Confidence resets reveal hierarchical adaptive learning in humans
title_fullStr Confidence resets reveal hierarchical adaptive learning in humans
title_full_unstemmed Confidence resets reveal hierarchical adaptive learning in humans
title_short Confidence resets reveal hierarchical adaptive learning in humans
title_sort confidence resets reveal hierarchical adaptive learning in humans
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6474633/
https://www.ncbi.nlm.nih.gov/pubmed/30964861
http://dx.doi.org/10.1371/journal.pcbi.1006972
work_keys_str_mv AT heilbronmicha confidenceresetsrevealhierarchicaladaptivelearninginhumans
AT meynielflorent confidenceresetsrevealhierarchicaladaptivelearninginhumans