Cargando…

Curriculum learning for human compositional generalization

Generalization (or transfer) is the ability to repurpose knowledge in novel settings. It is often asserted that generalization is an important ingredient of human intelligence, but its extent, nature, and determinants have proved controversial. Here, we examine this ability with a paradigm that form...

Descripción completa

Detalles Bibliográficos
Autores principales: Dekker, Ronald B., Otto, Fabian, Summerfield, Christopher
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9564093/
https://www.ncbi.nlm.nih.gov/pubmed/36191191
http://dx.doi.org/10.1073/pnas.2205582119
_version_ 1784808556268093440
author Dekker, Ronald B.
Otto, Fabian
Summerfield, Christopher
author_facet Dekker, Ronald B.
Otto, Fabian
Summerfield, Christopher
author_sort Dekker, Ronald B.
collection PubMed
description Generalization (or transfer) is the ability to repurpose knowledge in novel settings. It is often asserted that generalization is an important ingredient of human intelligence, but its extent, nature, and determinants have proved controversial. Here, we examine this ability with a paradigm that formalizes the transfer learning problem as one of recomposing existing functions to solve unseen problems. We find that people can generalize compositionally in ways that are elusive for standard neural networks and that human generalization benefits from training regimes in which items are axis aligned and temporally correlated. We describe a neural network model based around a Hebbian gating process that can capture how human generalization benefits from different training curricula. We additionally find that adult humans tend to learn composable functions asynchronously, exhibiting discontinuities in learning that resemble those seen in child development.
format Online
Article
Text
id pubmed-9564093
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-95640932022-10-15 Curriculum learning for human compositional generalization Dekker, Ronald B. Otto, Fabian Summerfield, Christopher Proc Natl Acad Sci U S A Biological Sciences Generalization (or transfer) is the ability to repurpose knowledge in novel settings. It is often asserted that generalization is an important ingredient of human intelligence, but its extent, nature, and determinants have proved controversial. Here, we examine this ability with a paradigm that formalizes the transfer learning problem as one of recomposing existing functions to solve unseen problems. We find that people can generalize compositionally in ways that are elusive for standard neural networks and that human generalization benefits from training regimes in which items are axis aligned and temporally correlated. We describe a neural network model based around a Hebbian gating process that can capture how human generalization benefits from different training curricula. We additionally find that adult humans tend to learn composable functions asynchronously, exhibiting discontinuities in learning that resemble those seen in child development. National Academy of Sciences 2022-10-03 2022-10-11 /pmc/articles/PMC9564093/ /pubmed/36191191 http://dx.doi.org/10.1073/pnas.2205582119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Biological Sciences
Dekker, Ronald B.
Otto, Fabian
Summerfield, Christopher
Curriculum learning for human compositional generalization
title Curriculum learning for human compositional generalization
title_full Curriculum learning for human compositional generalization
title_fullStr Curriculum learning for human compositional generalization
title_full_unstemmed Curriculum learning for human compositional generalization
title_short Curriculum learning for human compositional generalization
title_sort curriculum learning for human compositional generalization
topic Biological Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9564093/
https://www.ncbi.nlm.nih.gov/pubmed/36191191
http://dx.doi.org/10.1073/pnas.2205582119
work_keys_str_mv AT dekkerronaldb curriculumlearningforhumancompositionalgeneralization
AT ottofabian curriculumlearningforhumancompositionalgeneralization
AT summerfieldchristopher curriculumlearningforhumancompositionalgeneralization