Cargando…

A new item response theory model to adjust data allowing examinee choice

In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporat...

Descripción completa

Detalles Bibliográficos
Autores principales: Pena, Carolina Silva, Costa, Marcelo Azevedo, Braga Oliveira, Rivert Paulo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5794135/
https://www.ncbi.nlm.nih.gov/pubmed/29389996
http://dx.doi.org/10.1371/journal.pone.0191600
_version_ 1783297068555567104
author Pena, Carolina Silva
Costa, Marcelo Azevedo
Braga Oliveira, Rivert Paulo
author_facet Pena, Carolina Silva
Costa, Marcelo Azevedo
Braga Oliveira, Rivert Paulo
author_sort Pena, Carolina Silva
collection PubMed
description In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporates information from a novel representation of questionnaire data using network analysis. Three scenarios in which examinees select a subset of items were simulated. In the first scenario, the assumptions required to apply the standard Rasch model are met, thus establishing a reference for parameter accuracy. The second and third scenarios include five increasing levels of violating those assumptions. The results show substantial improvements over the standard model in item parameter recovery. Furthermore, the accuracy was closer to the reference in almost every evaluated scenario. To the best of our knowledge, this is the first proposal to obtain satisfactory IRT statistical estimates in the last two scenarios.
format Online
Article
Text
id pubmed-5794135
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-57941352018-02-16 A new item response theory model to adjust data allowing examinee choice Pena, Carolina Silva Costa, Marcelo Azevedo Braga Oliveira, Rivert Paulo PLoS One Research Article In a typical questionnaire testing situation, examinees are not allowed to choose which items they answer because of a technical issue in obtaining satisfactory statistical estimates of examinee ability and item difficulty. This paper introduces a new item response theory (IRT) model that incorporates information from a novel representation of questionnaire data using network analysis. Three scenarios in which examinees select a subset of items were simulated. In the first scenario, the assumptions required to apply the standard Rasch model are met, thus establishing a reference for parameter accuracy. The second and third scenarios include five increasing levels of violating those assumptions. The results show substantial improvements over the standard model in item parameter recovery. Furthermore, the accuracy was closer to the reference in almost every evaluated scenario. To the best of our knowledge, this is the first proposal to obtain satisfactory IRT statistical estimates in the last two scenarios. Public Library of Science 2018-02-01 /pmc/articles/PMC5794135/ /pubmed/29389996 http://dx.doi.org/10.1371/journal.pone.0191600 Text en © 2018 Pena et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Pena, Carolina Silva
Costa, Marcelo Azevedo
Braga Oliveira, Rivert Paulo
A new item response theory model to adjust data allowing examinee choice
title A new item response theory model to adjust data allowing examinee choice
title_full A new item response theory model to adjust data allowing examinee choice
title_fullStr A new item response theory model to adjust data allowing examinee choice
title_full_unstemmed A new item response theory model to adjust data allowing examinee choice
title_short A new item response theory model to adjust data allowing examinee choice
title_sort new item response theory model to adjust data allowing examinee choice
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5794135/
https://www.ncbi.nlm.nih.gov/pubmed/29389996
http://dx.doi.org/10.1371/journal.pone.0191600
work_keys_str_mv AT penacarolinasilva anewitemresponsetheorymodeltoadjustdataallowingexamineechoice
AT costamarceloazevedo anewitemresponsetheorymodeltoadjustdataallowingexamineechoice
AT bragaoliveirarivertpaulo anewitemresponsetheorymodeltoadjustdataallowingexamineechoice
AT penacarolinasilva newitemresponsetheorymodeltoadjustdataallowingexamineechoice
AT costamarceloazevedo newitemresponsetheorymodeltoadjustdataallowingexamineechoice
AT bragaoliveirarivertpaulo newitemresponsetheorymodeltoadjustdataallowingexamineechoice