Cargando…

Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods

Monitoring the progress of student learning is an important part of teachers’ data-based decision making. One such tool that can equip teachers with information about students’ learning progress throughout the school year and thus facilitate monitoring and instructional decision making is learning p...

Descripción completa

Detalles Bibliográficos
Autores principales: Forthmann, Boris, Förster, Natalie, Souvignier, Elmar
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8949320/
https://www.ncbi.nlm.nih.gov/pubmed/35324572
http://dx.doi.org/10.3390/jintelligence10010016
_version_ 1784674867187023872
author Forthmann, Boris
Förster, Natalie
Souvignier, Elmar
author_facet Forthmann, Boris
Förster, Natalie
Souvignier, Elmar
author_sort Forthmann, Boris
collection PubMed
description Monitoring the progress of student learning is an important part of teachers’ data-based decision making. One such tool that can equip teachers with information about students’ learning progress throughout the school year and thus facilitate monitoring and instructional decision making is learning progress assessments. In practical contexts and research, estimating learning progress has relied on approaches that seek to estimate progress either for each student separately or within overarching model frameworks, such as latent growth modeling. Two recently emerging lines of research for separately estimating student growth have examined robust estimation (to account for outliers) and Bayesian approaches (as opposed to commonly used frequentist methods). The aim of this work was to combine these approaches (i.e., robust Bayesian estimation) and extend these lines of research to the framework of linear latent growth models. In a sample of N = 4970 second-grade students who worked on the quop-L2 test battery (to assess reading comprehension) at eight measurement points, we compared three Bayesian linear latent growth models: (a) a Gaussian model, (b) a model based on Student’s t-distribution (i.e., a robust model), and (c) an asymmetric Laplace model (i.e., Bayesian quantile regression and an alternative robust model). Based on leave-one-out cross-validation and posterior predictive model checking, we found that both robust models outperformed the Gaussian model, and both robust models performed comparably well. While the Student’s t model performed statistically slightly better (yet not substantially so), the asymmetric Laplace model yielded somewhat more realistic posterior predictive samples and a higher degree of measurement precision (i.e., for those estimates that were either associated with the lowest or highest degree of measurement precision). The findings are discussed for the context of learning progress assessment.
format Online
Article
Text
id pubmed-8949320
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-89493202022-03-26 Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods Forthmann, Boris Förster, Natalie Souvignier, Elmar J Intell Article Monitoring the progress of student learning is an important part of teachers’ data-based decision making. One such tool that can equip teachers with information about students’ learning progress throughout the school year and thus facilitate monitoring and instructional decision making is learning progress assessments. In practical contexts and research, estimating learning progress has relied on approaches that seek to estimate progress either for each student separately or within overarching model frameworks, such as latent growth modeling. Two recently emerging lines of research for separately estimating student growth have examined robust estimation (to account for outliers) and Bayesian approaches (as opposed to commonly used frequentist methods). The aim of this work was to combine these approaches (i.e., robust Bayesian estimation) and extend these lines of research to the framework of linear latent growth models. In a sample of N = 4970 second-grade students who worked on the quop-L2 test battery (to assess reading comprehension) at eight measurement points, we compared three Bayesian linear latent growth models: (a) a Gaussian model, (b) a model based on Student’s t-distribution (i.e., a robust model), and (c) an asymmetric Laplace model (i.e., Bayesian quantile regression and an alternative robust model). Based on leave-one-out cross-validation and posterior predictive model checking, we found that both robust models outperformed the Gaussian model, and both robust models performed comparably well. While the Student’s t model performed statistically slightly better (yet not substantially so), the asymmetric Laplace model yielded somewhat more realistic posterior predictive samples and a higher degree of measurement precision (i.e., for those estimates that were either associated with the lowest or highest degree of measurement precision). The findings are discussed for the context of learning progress assessment. MDPI 2022-03-01 /pmc/articles/PMC8949320/ /pubmed/35324572 http://dx.doi.org/10.3390/jintelligence10010016 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Forthmann, Boris
Förster, Natalie
Souvignier, Elmar
Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title_full Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title_fullStr Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title_full_unstemmed Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title_short Shaky Student Growth? A Comparison of Robust Bayesian Learning Progress Estimation Methods
title_sort shaky student growth? a comparison of robust bayesian learning progress estimation methods
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8949320/
https://www.ncbi.nlm.nih.gov/pubmed/35324572
http://dx.doi.org/10.3390/jintelligence10010016
work_keys_str_mv AT forthmannboris shakystudentgrowthacomparisonofrobustbayesianlearningprogressestimationmethods
AT forsternatalie shakystudentgrowthacomparisonofrobustbayesianlearningprogressestimationmethods
AT souvignierelmar shakystudentgrowthacomparisonofrobustbayesianlearningprogressestimationmethods