Cargando…
How Important is the Choice of Bandwidth in Kernel Equating?
Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for ke...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
SAGE Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8640352/ https://www.ncbi.nlm.nih.gov/pubmed/34866710 http://dx.doi.org/10.1177/01466216211040486 |
_version_ | 1784609324832653312 |
---|---|
author | Wallin, Gabriel Häggström, Jenny Wiberg, Marie |
author_facet | Wallin, Gabriel Häggström, Jenny Wiberg, Marie |
author_sort | Wallin, Gabriel |
collection | PubMed |
description | Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for kernel equating, but no thorough comparison has been made between these methods. The overall aim is to compare these four methods together with two additional methods based on cross-validation in a simulation study. Both equivalent and non-equivalent group designs are used and the number of test takers, test length, and score distributions are all varied. The results show that sample size and test length are important factors for equating accuracy and precision. However, all bandwidth selection methods perform similarly with regards to the mean squared error and the differences in terms of equated scores are small, suggesting that the choice of bandwidth is not critical. The different bandwidth selection methods are also illustrated using real testing data from a college admissions test. Practical implications of the results from the simulation study and the empirical study are discussed. |
format | Online Article Text |
id | pubmed-8640352 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | SAGE Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-86403522021-12-04 How Important is the Choice of Bandwidth in Kernel Equating? Wallin, Gabriel Häggström, Jenny Wiberg, Marie Appl Psychol Meas Articles Kernel equating uses kernel smoothing techniques to continuize the discrete score distributions when equating test scores from an assessment test. The degree of smoothness of the continuous approximations is determined by the bandwidth. Four bandwidth selection methods are currently available for kernel equating, but no thorough comparison has been made between these methods. The overall aim is to compare these four methods together with two additional methods based on cross-validation in a simulation study. Both equivalent and non-equivalent group designs are used and the number of test takers, test length, and score distributions are all varied. The results show that sample size and test length are important factors for equating accuracy and precision. However, all bandwidth selection methods perform similarly with regards to the mean squared error and the differences in terms of equated scores are small, suggesting that the choice of bandwidth is not critical. The different bandwidth selection methods are also illustrated using real testing data from a college admissions test. Practical implications of the results from the simulation study and the empirical study are discussed. SAGE Publications 2021-10-20 2021-10 /pmc/articles/PMC8640352/ /pubmed/34866710 http://dx.doi.org/10.1177/01466216211040486 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 License (https://creativecommons.org/licenses/by/4.0/) which permits any use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access page (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
spellingShingle | Articles Wallin, Gabriel Häggström, Jenny Wiberg, Marie How Important is the Choice of Bandwidth in Kernel Equating? |
title | How Important is the Choice of Bandwidth in Kernel Equating? |
title_full | How Important is the Choice of Bandwidth in Kernel Equating? |
title_fullStr | How Important is the Choice of Bandwidth in Kernel Equating? |
title_full_unstemmed | How Important is the Choice of Bandwidth in Kernel Equating? |
title_short | How Important is the Choice of Bandwidth in Kernel Equating? |
title_sort | how important is the choice of bandwidth in kernel equating? |
topic | Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8640352/ https://www.ncbi.nlm.nih.gov/pubmed/34866710 http://dx.doi.org/10.1177/01466216211040486 |
work_keys_str_mv | AT wallingabriel howimportantisthechoiceofbandwidthinkernelequating AT haggstromjenny howimportantisthechoiceofbandwidthinkernelequating AT wibergmarie howimportantisthechoiceofbandwidthinkernelequating |