Cargando…

Modeling changes in probabilistic reinforcement learning during adolescence

In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in you...

Descripción completa

Detalles Bibliográficos
Autores principales: Xia, Liyu, Master, Sarah L., Eckstein, Maria K., Baribault, Beth, Dahl, Ronald E., Wilbrecht, Linda, Collins, Anne Gabrielle Eva
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8279421/
https://www.ncbi.nlm.nih.gov/pubmed/34197447
http://dx.doi.org/10.1371/journal.pcbi.1008524
_version_ 1783722452515291136
author Xia, Liyu
Master, Sarah L.
Eckstein, Maria K.
Baribault, Beth
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne Gabrielle Eva
author_facet Xia, Liyu
Master, Sarah L.
Eckstein, Maria K.
Baribault, Beth
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne Gabrielle Eva
author_sort Xia, Liyu
collection PubMed
description In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in youths compared to adults, while others suggest it may be more efficient in youths in mid adolescence. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants’ performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time scale); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development.
format Online
Article
Text
id pubmed-8279421
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-82794212021-07-26 Modeling changes in probabilistic reinforcement learning during adolescence Xia, Liyu Master, Sarah L. Eckstein, Maria K. Baribault, Beth Dahl, Ronald E. Wilbrecht, Linda Collins, Anne Gabrielle Eva PLoS Comput Biol Research Article In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in youths compared to adults, while others suggest it may be more efficient in youths in mid adolescence. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants’ performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time scale); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development. Public Library of Science 2021-07-01 /pmc/articles/PMC8279421/ /pubmed/34197447 http://dx.doi.org/10.1371/journal.pcbi.1008524 Text en © 2021 Xia et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Xia, Liyu
Master, Sarah L.
Eckstein, Maria K.
Baribault, Beth
Dahl, Ronald E.
Wilbrecht, Linda
Collins, Anne Gabrielle Eva
Modeling changes in probabilistic reinforcement learning during adolescence
title Modeling changes in probabilistic reinforcement learning during adolescence
title_full Modeling changes in probabilistic reinforcement learning during adolescence
title_fullStr Modeling changes in probabilistic reinforcement learning during adolescence
title_full_unstemmed Modeling changes in probabilistic reinforcement learning during adolescence
title_short Modeling changes in probabilistic reinforcement learning during adolescence
title_sort modeling changes in probabilistic reinforcement learning during adolescence
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8279421/
https://www.ncbi.nlm.nih.gov/pubmed/34197447
http://dx.doi.org/10.1371/journal.pcbi.1008524
work_keys_str_mv AT xialiyu modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT mastersarahl modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT ecksteinmariak modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT baribaultbeth modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT dahlronalde modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT wilbrechtlinda modelingchangesinprobabilisticreinforcementlearningduringadolescence
AT collinsannegabrielleeva modelingchangesinprobabilisticreinforcementlearningduringadolescence