Cargando…

Automated Test Assembly for Multistage Testing With Cognitive Diagnosis

Computer multistage adaptive test (MST) combines the advantages of paper and pencil-based test (P&P) and computer-adaptive test (CAT). As CAT, MST is adaptive based on modules; as P&P, MST can meet the need of test developers to manage test forms and keep test forms parallel. Cognitive diagn...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Guiyu, Cai, Yan, Gao, Xuliang, Wang, Daxun, Tu, Dongbo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8136431/
https://www.ncbi.nlm.nih.gov/pubmed/34025486
http://dx.doi.org/10.3389/fpsyg.2021.509844
_version_ 1783695443007373312
author Li, Guiyu
Cai, Yan
Gao, Xuliang
Wang, Daxun
Tu, Dongbo
author_facet Li, Guiyu
Cai, Yan
Gao, Xuliang
Wang, Daxun
Tu, Dongbo
author_sort Li, Guiyu
collection PubMed
description Computer multistage adaptive test (MST) combines the advantages of paper and pencil-based test (P&P) and computer-adaptive test (CAT). As CAT, MST is adaptive based on modules; as P&P, MST can meet the need of test developers to manage test forms and keep test forms parallel. Cognitive diagnosis (CD) can accurately measure students’ knowledge states (KSs) and provide diagnostic information, which is conducive to student’s self-learning and teacher’s targeted teaching. Although MST and CD have a lot of advantages, many factors prevent MST from applying to CD. In this study, we first attempt to employ automated test assembly (ATA) to achieve the objectives of MST in the application of CD (called CD-MST) via heuristic algorithms. The mean correct response probability of all KSs for each item is used to describe the item difficulty of CD. The attribute reliability in CD is defined as the test quantitative target. A simulation study with the G-DINA model (generalized deterministic input noisy “and” gate model) was carried out to investigate the proposed CD-MST, and the results showed that the assembled panels of CD-MST satisfied the statistical and the non-statistical constraints.
format Online
Article
Text
id pubmed-8136431
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-81364312021-05-21 Automated Test Assembly for Multistage Testing With Cognitive Diagnosis Li, Guiyu Cai, Yan Gao, Xuliang Wang, Daxun Tu, Dongbo Front Psychol Psychology Computer multistage adaptive test (MST) combines the advantages of paper and pencil-based test (P&P) and computer-adaptive test (CAT). As CAT, MST is adaptive based on modules; as P&P, MST can meet the need of test developers to manage test forms and keep test forms parallel. Cognitive diagnosis (CD) can accurately measure students’ knowledge states (KSs) and provide diagnostic information, which is conducive to student’s self-learning and teacher’s targeted teaching. Although MST and CD have a lot of advantages, many factors prevent MST from applying to CD. In this study, we first attempt to employ automated test assembly (ATA) to achieve the objectives of MST in the application of CD (called CD-MST) via heuristic algorithms. The mean correct response probability of all KSs for each item is used to describe the item difficulty of CD. The attribute reliability in CD is defined as the test quantitative target. A simulation study with the G-DINA model (generalized deterministic input noisy “and” gate model) was carried out to investigate the proposed CD-MST, and the results showed that the assembled panels of CD-MST satisfied the statistical and the non-statistical constraints. Frontiers Media S.A. 2021-05-06 /pmc/articles/PMC8136431/ /pubmed/34025486 http://dx.doi.org/10.3389/fpsyg.2021.509844 Text en Copyright © 2021 Li, Cai, Gao, Wang and Tu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Li, Guiyu
Cai, Yan
Gao, Xuliang
Wang, Daxun
Tu, Dongbo
Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title_full Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title_fullStr Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title_full_unstemmed Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title_short Automated Test Assembly for Multistage Testing With Cognitive Diagnosis
title_sort automated test assembly for multistage testing with cognitive diagnosis
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8136431/
https://www.ncbi.nlm.nih.gov/pubmed/34025486
http://dx.doi.org/10.3389/fpsyg.2021.509844
work_keys_str_mv AT liguiyu automatedtestassemblyformultistagetestingwithcognitivediagnosis
AT caiyan automatedtestassemblyformultistagetestingwithcognitivediagnosis
AT gaoxuliang automatedtestassemblyformultistagetestingwithcognitivediagnosis
AT wangdaxun automatedtestassemblyformultistagetestingwithcognitivediagnosis
AT tudongbo automatedtestassemblyformultistagetestingwithcognitivediagnosis