Cargando…
Modeling changes in probabilistic reinforcement learning during adolescence
In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in you...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8279421/ https://www.ncbi.nlm.nih.gov/pubmed/34197447 http://dx.doi.org/10.1371/journal.pcbi.1008524 |
_version_ | 1783722452515291136 |
---|---|
author | Xia, Liyu Master, Sarah L. Eckstein, Maria K. Baribault, Beth Dahl, Ronald E. Wilbrecht, Linda Collins, Anne Gabrielle Eva |
author_facet | Xia, Liyu Master, Sarah L. Eckstein, Maria K. Baribault, Beth Dahl, Ronald E. Wilbrecht, Linda Collins, Anne Gabrielle Eva |
author_sort | Xia, Liyu |
collection | PubMed |
description | In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in youths compared to adults, while others suggest it may be more efficient in youths in mid adolescence. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants’ performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time scale); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development. |
format | Online Article Text |
id | pubmed-8279421 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-82794212021-07-26 Modeling changes in probabilistic reinforcement learning during adolescence Xia, Liyu Master, Sarah L. Eckstein, Maria K. Baribault, Beth Dahl, Ronald E. Wilbrecht, Linda Collins, Anne Gabrielle Eva PLoS Comput Biol Research Article In the real world, many relationships between events are uncertain and probabilistic. Uncertainty is also likely to be a more common feature of daily experience for youth because they have less experience to draw from than adults. Some studies suggest probabilistic learning may be inefficient in youths compared to adults, while others suggest it may be more efficient in youths in mid adolescence. Here we used a probabilistic reinforcement learning task to test how youth age 8-17 (N = 187) and adults age 18-30 (N = 110) learn about stable probabilistic contingencies. Performance increased with age through early-twenties, then stabilized. Using hierarchical Bayesian methods to fit computational reinforcement learning models, we show that all participants’ performance was better explained by models in which negative outcomes had minimal to no impact on learning. The performance increase over age was driven by 1) an increase in learning rate (i.e. decrease in integration time scale); 2) a decrease in noisy/exploratory choices. In mid-adolescence age 13-15, salivary testosterone and learning rate were positively related. We discuss our findings in the context of other studies and hypotheses about adolescent brain development. Public Library of Science 2021-07-01 /pmc/articles/PMC8279421/ /pubmed/34197447 http://dx.doi.org/10.1371/journal.pcbi.1008524 Text en © 2021 Xia et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Xia, Liyu Master, Sarah L. Eckstein, Maria K. Baribault, Beth Dahl, Ronald E. Wilbrecht, Linda Collins, Anne Gabrielle Eva Modeling changes in probabilistic reinforcement learning during adolescence |
title | Modeling changes in probabilistic reinforcement learning during adolescence |
title_full | Modeling changes in probabilistic reinforcement learning during adolescence |
title_fullStr | Modeling changes in probabilistic reinforcement learning during adolescence |
title_full_unstemmed | Modeling changes in probabilistic reinforcement learning during adolescence |
title_short | Modeling changes in probabilistic reinforcement learning during adolescence |
title_sort | modeling changes in probabilistic reinforcement learning during adolescence |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8279421/ https://www.ncbi.nlm.nih.gov/pubmed/34197447 http://dx.doi.org/10.1371/journal.pcbi.1008524 |
work_keys_str_mv | AT xialiyu modelingchangesinprobabilisticreinforcementlearningduringadolescence AT mastersarahl modelingchangesinprobabilisticreinforcementlearningduringadolescence AT ecksteinmariak modelingchangesinprobabilisticreinforcementlearningduringadolescence AT baribaultbeth modelingchangesinprobabilisticreinforcementlearningduringadolescence AT dahlronalde modelingchangesinprobabilisticreinforcementlearningduringadolescence AT wilbrechtlinda modelingchangesinprobabilisticreinforcementlearningduringadolescence AT collinsannegabrielleeva modelingchangesinprobabilisticreinforcementlearningduringadolescence |