Cargando…

Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation

In standardized testing, equating is used to ensure comparability of test scores across multiple test administrations. One equipercentile observed-score equating method is kernel equating, where an essential step is to obtain continuous approximations to the discrete score distributions by applying...

Descripción completa

Detalles Bibliográficos
Autores principales: Marcq, Kseniia, Andersson, Björn
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9073636/
https://www.ncbi.nlm.nih.gov/pubmed/35528269
http://dx.doi.org/10.1177/01466216211066601
_version_ 1784701332120141824
author Marcq, Kseniia
Andersson, Björn
author_facet Marcq, Kseniia
Andersson, Björn
author_sort Marcq, Kseniia
collection PubMed
description In standardized testing, equating is used to ensure comparability of test scores across multiple test administrations. One equipercentile observed-score equating method is kernel equating, where an essential step is to obtain continuous approximations to the discrete score distributions by applying a kernel with a smoothing bandwidth parameter. When estimating the bandwidth, additional variability is introduced which is currently not accounted for when calculating the standard errors of equating. This poses a threat to the accuracy of the standard errors of equating. In this study, the asymptotic variance of the bandwidth parameter estimator is derived and a modified method for calculating the standard error of equating that accounts for the bandwidth estimation variability is introduced for the equivalent groups design. A simulation study is used to verify the derivations and confirm the accuracy of the modified method across several sample sizes and test lengths as compared to the existing method and the Monte Carlo standard error of equating estimates. The results show that the modified standard errors of equating are accurate under the considered conditions. Furthermore, the modified and the existing methods produce similar results which suggest that the bandwidth variability impact on the standard error of equating is minimal.
format Online
Article
Text
id pubmed-9073636
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-90736362022-05-07 Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation Marcq, Kseniia Andersson, Björn Appl Psychol Meas Articles In standardized testing, equating is used to ensure comparability of test scores across multiple test administrations. One equipercentile observed-score equating method is kernel equating, where an essential step is to obtain continuous approximations to the discrete score distributions by applying a kernel with a smoothing bandwidth parameter. When estimating the bandwidth, additional variability is introduced which is currently not accounted for when calculating the standard errors of equating. This poses a threat to the accuracy of the standard errors of equating. In this study, the asymptotic variance of the bandwidth parameter estimator is derived and a modified method for calculating the standard error of equating that accounts for the bandwidth estimation variability is introduced for the equivalent groups design. A simulation study is used to verify the derivations and confirm the accuracy of the modified method across several sample sizes and test lengths as compared to the existing method and the Monte Carlo standard error of equating estimates. The results show that the modified standard errors of equating are accurate under the considered conditions. Furthermore, the modified and the existing methods produce similar results which suggest that the bandwidth variability impact on the standard error of equating is minimal. SAGE Publications 2022-03-07 2022-05 /pmc/articles/PMC9073636/ /pubmed/35528269 http://dx.doi.org/10.1177/01466216211066601 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Articles
Marcq, Kseniia
Andersson, Björn
Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title_full Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title_fullStr Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title_full_unstemmed Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title_short Standard Errors of Kernel Equating: Accounting for Bandwidth Estimation
title_sort standard errors of kernel equating: accounting for bandwidth estimation
topic Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9073636/
https://www.ncbi.nlm.nih.gov/pubmed/35528269
http://dx.doi.org/10.1177/01466216211066601
work_keys_str_mv AT marcqkseniia standarderrorsofkernelequatingaccountingforbandwidthestimation
AT anderssonbjorn standarderrorsofkernelequatingaccountingforbandwidthestimation