Cargando…
A new item response theory model to adjust data allowing examinee choice
In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporat...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5794135/ https://www.ncbi.nlm.nih.gov/pubmed/29389996 http://dx.doi.org/10.1371/journal.pone.0191600 |
_version_ | 1783297068555567104 |
---|---|
author | Pena, Carolina Silva Costa, Marcelo Azevedo Braga Oliveira, Rivert Paulo |
author_facet | Pena, Carolina Silva Costa, Marcelo Azevedo Braga Oliveira, Rivert Paulo |
author_sort | Pena, Carolina Silva |
collection | PubMed |
description | In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporates information from a novel representation of questionnaire data using network analysis. Three scenarios in which examinees select a subset of items were simulated. In the first scenario, the assumptions required to apply the standard Rasch model are met, thus establishing a reference for parameter accuracy. The second and third scenarios include five increasing levels of violating those assumptions. The results show substantial improvements over the standard model in item parameter recovery. Furthermore, the accuracy was closer to the reference in almost every evaluated scenario. To the best of our knowledge, this is the first proposal to obtain satisfactory IRT statistical estimates in the last two scenarios. |
format | Online Article Text |
id | pubmed-5794135 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-57941352018-02-16 A new item response theory model to adjust data allowing examinee choice Pena, Carolina Silva Costa, Marcelo Azevedo Braga Oliveira, Rivert Paulo PLoS One Research Article In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporates information from a novel representation of questionnaire data using network analysis. Three scenarios in which examinees select a subset of items were simulated. In the first scenario, the assumptions required to apply the standard Rasch model are met, thus establishing a reference for parameter accuracy. The second and third scenarios include five increasing levels of violating those assumptions. The results show substantial improvements over the standard model in item parameter recovery. Furthermore, the accuracy was closer to the reference in almost every evaluated scenario. To the best of our knowledge, this is the first proposal to obtain satisfactory IRT statistical estimates in the last two scenarios. Public Library of Science 2018-02-01 /pmc/articles/PMC5794135/ /pubmed/29389996 http://dx.doi.org/10.1371/journal.pone.0191600 Text en © 2018 Pena et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Pena, Carolina Silva Costa, Marcelo Azevedo Braga Oliveira, Rivert Paulo A new item response theory model to adjust data allowing examinee choice |
title | A new item response theory model to adjust data allowing examinee choice |
title_full | A new item response theory model to adjust data allowing examinee choice |
title_fullStr | A new item response theory model to adjust data allowing examinee choice |
title_full_unstemmed | A new item response theory model to adjust data allowing examinee choice |
title_short | A new item response theory model to adjust data allowing examinee choice |
title_sort | new item response theory model to adjust data allowing examinee choice |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5794135/ https://www.ncbi.nlm.nih.gov/pubmed/29389996 http://dx.doi.org/10.1371/journal.pone.0191600 |
work_keys_str_mv | AT penacarolinasilva anewitemresponsetheorymodeltoadjustdataallowingexamineechoice AT costamarceloazevedo anewitemresponsetheorymodeltoadjustdataallowingexamineechoice AT bragaoliveirarivertpaulo anewitemresponsetheorymodeltoadjustdataallowingexamineechoice AT penacarolinasilva newitemresponsetheorymodeltoadjustdataallowingexamineechoice AT costamarceloazevedo newitemresponsetheorymodeltoadjustdataallowingexamineechoice AT bragaoliveirarivertpaulo newitemresponsetheorymodeltoadjustdataallowingexamineechoice |