Cargando…
The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods*
Bayesian Nonparametric (BNP) modelling can be used to obtain more detailed information in test equating studies and to increase the accuracy of equating by accounting for covariates. In this study, two covariates are included in the equating under the Bayes nonparametric model, one is continuous, an...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
SAGE Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10450720/ https://www.ncbi.nlm.nih.gov/pubmed/34236901 http://dx.doi.org/10.1177/00368504211028371 |
_version_ | 1785095260686254080 |
---|---|
author | Yurtcu, Meltem Kelecioglu, Hülya Boone, Edward L |
author_facet | Yurtcu, Meltem Kelecioglu, Hülya Boone, Edward L |
author_sort | Yurtcu, Meltem |
collection | PubMed |
description | Bayesian Nonparametric (BNP) modelling can be used to obtain more detailed information in test equating studies and to increase the accuracy of equating by accounting for covariates. In this study, two covariates are included in the equating under the Bayes nonparametric model, one is continuous, and the other is discrete. Scores equated with this model were obtained for a single group design for a small group in the study. The equated scores obtained with the model were compared with the mean and linear equating methods in the Classical Test Theory. Considering the equated scores obtained from three different methods, it was found that the equated scores obtained with the BNP model produced a distribution closer to the target test. Even the classical methods will give a good result with the smallest error when using a small sample, making equating studies valuable. The inclusion of the covariates in the model in the classical test equating process is based on some assumptions and cannot be achieved especially using small groups. The BNP model will be more beneficial than using frequentist methods, regardless of this limitation. Information about booklets and variables can be obtained from the distributors and equated scores that obtained with the BNP model. In this case, it makes it possible to compare sub-categories. This can be expressed as indicating the presence of differential item functioning (DIF). Therefore, the BNP model can be used actively in test equating studies, and it provides an opportunity to examine the characteristics of the individual participants at the same time. Thus, it allows test equating even in a small sample and offers the opportunity to reach a value closer to the scores in the target test. |
format | Online Article Text |
id | pubmed-10450720 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | SAGE Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-104507202023-08-26 The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* Yurtcu, Meltem Kelecioglu, Hülya Boone, Edward L Sci Prog Article Bayesian Nonparametric (BNP) modelling can be used to obtain more detailed information in test equating studies and to increase the accuracy of equating by accounting for covariates. In this study, two covariates are included in the equating under the Bayes nonparametric model, one is continuous, and the other is discrete. Scores equated with this model were obtained for a single group design for a small group in the study. The equated scores obtained with the model were compared with the mean and linear equating methods in the Classical Test Theory. Considering the equated scores obtained from three different methods, it was found that the equated scores obtained with the BNP model produced a distribution closer to the target test. Even the classical methods will give a good result with the smallest error when using a small sample, making equating studies valuable. The inclusion of the covariates in the model in the classical test equating process is based on some assumptions and cannot be achieved especially using small groups. The BNP model will be more beneficial than using frequentist methods, regardless of this limitation. Information about booklets and variables can be obtained from the distributors and equated scores that obtained with the BNP model. In this case, it makes it possible to compare sub-categories. This can be expressed as indicating the presence of differential item functioning (DIF). Therefore, the BNP model can be used actively in test equating studies, and it provides an opportunity to examine the characteristics of the individual participants at the same time. Thus, it allows test equating even in a small sample and offers the opportunity to reach a value closer to the scores in the target test. SAGE Publications 2021-07-08 /pmc/articles/PMC10450720/ /pubmed/34236901 http://dx.doi.org/10.1177/00368504211028371 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by-nc/4.0/This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
spellingShingle | Article Yurtcu, Meltem Kelecioglu, Hülya Boone, Edward L The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title | The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title_full | The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title_fullStr | The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title_full_unstemmed | The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title_short | The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods* |
title_sort | comparison of the scores obtained by bayesian nonparametric model and classical test theory methods* |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10450720/ https://www.ncbi.nlm.nih.gov/pubmed/34236901 http://dx.doi.org/10.1177/00368504211028371 |
work_keys_str_mv | AT yurtcumeltem thecomparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods AT keleciogluhulya thecomparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods AT booneedwardl thecomparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods AT yurtcumeltem comparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods AT keleciogluhulya comparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods AT booneedwardl comparisonofthescoresobtainedbybayesiannonparametricmodelandclassicaltesttheorymethods |