Cargando…

Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory

A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐poste...

Descripción completa

Detalles Bibliográficos
Autores principales: Debelak, Rudolf, Pawel, Samuel, Strobl, Carolin, Merkle, Edgar C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9796736/
https://www.ncbi.nlm.nih.gov/pubmed/35670000
http://dx.doi.org/10.1111/bmsp.12275
_version_ 1784860554482941952
author Debelak, Rudolf
Pawel, Samuel
Strobl, Carolin
Merkle, Edgar C.
author_facet Debelak, Rudolf
Pawel, Samuel
Strobl, Carolin
Merkle, Edgar C.
author_sort Debelak, Rudolf
collection PubMed
description A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐posteriori estimates and multiple‐group IRT models. We propose two families of statistical tests, which are based on an approximation using a pooled variance method, or on a simulation approach based on asymptotic results. The resulting tests were evaluated by a simulation study, which investigated their sensitivity against differential item functioning with respect to a categorical or continuous person covariate in the two‐ and three‐parametric logistic models. Whereas the method based on pooled variance was found to be useful in practice with maximum likelihood as well as maximum‐a‐posteriori estimates, the simulation‐based approach was found to require large sample sizes to lead to satisfactory results.
format Online
Article
Text
id pubmed-9796736
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-97967362023-01-04 Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory Debelak, Rudolf Pawel, Samuel Strobl, Carolin Merkle, Edgar C. Br J Math Stat Psychol Original Articles A family of score‐based tests has been proposed in recent years for assessing the invariance of model parameters in several models of item response theory (IRT). These tests were originally developed in a maximum likelihood framework. This study discusses analogous tests for Bayesian maximum‐a‐posteriori estimates and multiple‐group IRT models. We propose two families of statistical tests, which are based on an approximation using a pooled variance method, or on a simulation approach based on asymptotic results. The resulting tests were evaluated by a simulation study, which investigated their sensitivity against differential item functioning with respect to a categorical or continuous person covariate in the two‐ and three‐parametric logistic models. Whereas the method based on pooled variance was found to be useful in practice with maximum likelihood as well as maximum‐a‐posteriori estimates, the simulation‐based approach was found to require large sample sizes to lead to satisfactory results. John Wiley and Sons Inc. 2022-06-06 2022-11 /pmc/articles/PMC9796736/ /pubmed/35670000 http://dx.doi.org/10.1111/bmsp.12275 Text en © 2022 The Authors. British Journal of Mathematical and Statistical Psychology published by John Wiley & Sons Ltd on behalf of British Psychological Society. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Original Articles
Debelak, Rudolf
Pawel, Samuel
Strobl, Carolin
Merkle, Edgar C.
Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title_full Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title_fullStr Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title_full_unstemmed Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title_short Score‐based measurement invariance checks for Bayesian maximum‐a‐posteriori estimates in item response theory
title_sort score‐based measurement invariance checks for bayesian maximum‐a‐posteriori estimates in item response theory
topic Original Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9796736/
https://www.ncbi.nlm.nih.gov/pubmed/35670000
http://dx.doi.org/10.1111/bmsp.12275
work_keys_str_mv AT debelakrudolf scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory
AT pawelsamuel scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory
AT stroblcarolin scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory
AT merkleedgarc scorebasedmeasurementinvariancechecksforbayesianmaximumaposterioriestimatesinitemresponsetheory