Cargando…

How Important is the Choice of Bandwidth in Kernel Equating?

Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for ke...

Descripción completa

Detalles Bibliográficos
Autores principales: Wallin, Gabriel, Häggström, Jenny, Wiberg, Marie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8640352/
https://www.ncbi.nlm.nih.gov/pubmed/34866710
http://dx.doi.org/10.1177/01466216211040486
_version_ 1784609324832653312
author Wallin, Gabriel
Häggström, Jenny
Wiberg, Marie
author_facet Wallin, Gabriel
Häggström, Jenny
Wiberg, Marie
author_sort Wallin, Gabriel
collection PubMed
description Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for kernel equating, but no thorough comparison has been made between these methods. The overall aim is to compare these four methods together with two additional methods based on cross-validation in a simulation study. Both equivalent and non-equivalent group designs are used and the number of test takers, test length, and score distributions are all varied. The results show that sample size and test length are important factors for equating accuracy and precision. However, all bandwidth selection methods perform similarly with regards to the mean squared error and the differences in terms of equated scores are small, suggesting that the choice of bandwidth is not critical. The different bandwidth selection methods are also illustrated using real testing data from a college admissions test. Practical implications of the results from the simulation study and the empirical study are discussed.
format Online
Article
Text
id pubmed-8640352
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-86403522021-12-04 How Important is the Choice of Bandwidth in Kernel Equating? Wallin, Gabriel Häggström, Jenny Wiberg, Marie Appl Psychol Meas Articles Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for kernel equating, but no thorough comparison has been made between these methods. The overall aim is to compare these four methods together with two additional methods based on cross-validation in a simulation study. Both equivalent and non-equivalent group designs are used and the number of test takers, test length, and score distributions are all varied. The results show that sample size and test length are important factors for equating accuracy and precision. However, all bandwidth selection methods perform similarly with regards to the mean squared error and the differences in terms of equated scores are small, suggesting that the choice of bandwidth is not critical. The different bandwidth selection methods are also illustrated using real testing data from a college admissions test. Practical implications of the results from the simulation study and the empirical study are discussed. SAGE Publications 2021-10-20 2021-10 /pmc/articles/PMC8640352/ /pubmed/34866710 http://dx.doi.org/10.1177/01466216211040486 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Articles
Wallin, Gabriel
Häggström, Jenny
Wiberg, Marie
How Important is the Choice of Bandwidth in Kernel Equating?
title How Important is the Choice of Bandwidth in Kernel Equating?
title_full How Important is the Choice of Bandwidth in Kernel Equating?
title_fullStr How Important is the Choice of Bandwidth in Kernel Equating?
title_full_unstemmed How Important is the Choice of Bandwidth in Kernel Equating?
title_short How Important is the Choice of Bandwidth in Kernel Equating?
title_sort how important is the choice of bandwidth in kernel equating?
topic Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8640352/
https://www.ncbi.nlm.nih.gov/pubmed/34866710
http://dx.doi.org/10.1177/01466216211040486
work_keys_str_mv AT wallingabriel howimportantisthechoiceofbandwidthinkernelequating
AT haggstromjenny howimportantisthechoiceofbandwidthinkernelequating
AT wibergmarie howimportantisthechoiceofbandwidthinkernelequating