Cargando…

Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal

During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of pers...

Descripción completa

Detalles Bibliográficos
Autores principales: Eckstein, Maria K., Master, Sarah L., Dahl, Ronald E., Wilbrecht, Linda, Collins, Anne G.E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9108470/
https://www.ncbi.nlm.nih.gov/pubmed/35537273
http://dx.doi.org/10.1016/j.dcn.2022.101106
_version_ 1784708711320649728
author Eckstein, Maria K.
Master, Sarah L.
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne G.E.
author_facet Eckstein, Maria K.
Master, Sarah L.
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne G.E.
author_sort Eckstein, Maria K.
collection PubMed
description During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8–30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference (BI). The RL parameter for learning from negative outcomes and the BI parameters specifying participants’ mental models were closest to optimal in mid-teen adolescents, suggesting a central role in adolescent cognitive processing. By contrast, persistence and noise parameters improved monotonically with age. We distilled the insights of RL and BI using principal component analysis and found that three shared components interacted to form the adolescent performance peak: adult-like behavioral quality, child-like time scales, and developmentally-unique processing of positive feedback. This research highlights adolescence as a neurodevelopmental window that can create performance advantages in volatile and uncertain environments. It also shows how detailed insights can be gleaned by using cognitive models in new ways.
format Online
Article
Text
id pubmed-9108470
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-91084702022-05-17 Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal Eckstein, Maria K. Master, Sarah L. Dahl, Ronald E. Wilbrecht, Linda Collins, Anne G.E. Dev Cogn Neurosci Original Research During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8–30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference (BI). The RL parameter for learning from negative outcomes and the BI parameters specifying participants’ mental models were closest to optimal in mid-teen adolescents, suggesting a central role in adolescent cognitive processing. By contrast, persistence and noise parameters improved monotonically with age. We distilled the insights of RL and BI using principal component analysis and found that three shared components interacted to form the adolescent performance peak: adult-like behavioral quality, child-like time scales, and developmentally-unique processing of positive feedback. This research highlights adolescence as a neurodevelopmental window that can create performance advantages in volatile and uncertain environments. It also shows how detailed insights can be gleaned by using cognitive models in new ways. Elsevier 2022-04-22 /pmc/articles/PMC9108470/ /pubmed/35537273 http://dx.doi.org/10.1016/j.dcn.2022.101106 Text en © 2022 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Original Research
Eckstein, Maria K.
Master, Sarah L.
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne G.E.
Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title_full Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title_fullStr Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title_full_unstemmed Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title_short Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
title_sort reinforcement learning and bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal
topic Original Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9108470/
https://www.ncbi.nlm.nih.gov/pubmed/35537273
http://dx.doi.org/10.1016/j.dcn.2022.101106
work_keys_str_mv AT ecksteinmariak reinforcementlearningandbayesianinferenceprovidecomplementarymodelsfortheuniqueadvantageofadolescentsinstochasticreversal
AT mastersarahl reinforcementlearningandbayesianinferenceprovidecomplementarymodelsfortheuniqueadvantageofadolescentsinstochasticreversal
AT dahlronalde reinforcementlearningandbayesianinferenceprovidecomplementarymodelsfortheuniqueadvantageofadolescentsinstochasticreversal
AT wilbrechtlinda reinforcementlearningandbayesianinferenceprovidecomplementarymodelsfortheuniqueadvantageofadolescentsinstochasticreversal
AT collinsannege reinforcementlearningandbayesianinferenceprovidecomplementarymodelsfortheuniqueadvantageofadolescentsinstochasticreversal