Cargando…
Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐poste...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9796736/ https://www.ncbi.nlm.nih.gov/pubmed/35670000 http://dx.doi.org/10.1111/bmsp.12275 |
_version_ | 1784860554482941952 |
---|---|
author | Debelak, Rudolf Pawel, Samuel Strobl, Carolin Merkle, Edgar C. |
author_facet | Debelak, Rudolf Pawel, Samuel Strobl, Carolin Merkle, Edgar C. |
author_sort | Debelak, Rudolf |
collection | PubMed |
description | A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐posteriori estimates and multiple‐group IRT models. We propose two families of statistical tests, which are based on an approximation using a pooled variance method, or on a simulation approach based on asymptotic results. The resulting tests were evaluated by a simulation study, which investigated their sensitivity against differential item functioning with respect to a categorical or continuous person covariate in the two‐ and three‐parametric logistic models. Whereas the method based on pooled variance was found to be useful in practice with maximum likelihood as well as maximum‐a‐posteriori estimates, the simulation‐based approach was found to require large sample sizes to lead to satisfactory results. |
format | Online Article Text |
id | pubmed-9796736 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-97967362023-01-04 Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory Debelak, Rudolf Pawel, Samuel Strobl, Carolin Merkle, Edgar C. Br J Math Stat Psychol Original Articles A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐posteriori estimates and multiple‐group IRT models. We propose two families of statistical tests, which are based on an approximation using a pooled variance method, or on a simulation approach based on asymptotic results. The resulting tests were evaluated by a simulation study, which investigated their sensitivity against differential item functioning with respect to a categorical or continuous person covariate in the two‐ and three‐parametric logistic models. Whereas the method based on pooled variance was found to be useful in practice with maximum likelihood as well as maximum‐a‐posteriori estimates, the simulation‐based approach was found to require large sample sizes to lead to satisfactory results. John Wiley and Sons Inc. 2022-06-06 2022-11 /pmc/articles/PMC9796736/ /pubmed/35670000 http://dx.doi.org/10.1111/bmsp.12275 Text en © 2022 The Authors. British Journal of Mathematical and Statistical Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Original Articles Debelak, Rudolf Pawel, Samuel Strobl, Carolin Merkle, Edgar C. Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title | Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title_full | Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title_fullStr | Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title_full_unstemmed | Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title_short | Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory |
title_sort | score‐based measurement invariance checks for bayesian maximum‐a‐posteriori estimates in item response theory |
topic | Original Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9796736/ https://www.ncbi.nlm.nih.gov/pubmed/35670000 http://dx.doi.org/10.1111/bmsp.12275 |
work_keys_str_mv | AT debelakrudolf scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory AT pawelsamuel scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory AT stroblcarolin scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory AT merkleedgarc scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory |