Cargando…

Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach

Noncognitive constructs are commonly assessed in educational and organizational research. They are often measured by summing scores across items, which implicitly assumes a dominance item response process. However, research has shown that the unfolding response process may better characterize how pe...

Descripción completa

Detalles Bibliográficos
Autores principales: Tu, Naidan, Zhang, Bo, Angrave, Lawrence, Sun, Tianjun, Neuman, Mathew
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10455612/
https://www.ncbi.nlm.nih.gov/pubmed/37623546
http://dx.doi.org/10.3390/jintelligence11080163
_version_ 1785096495062581248
author Tu, Naidan
Zhang, Bo
Angrave, Lawrence
Sun, Tianjun
Neuman, Mathew
author_facet Tu, Naidan
Zhang, Bo
Angrave, Lawrence
Sun, Tianjun
Neuman, Mathew
author_sort Tu, Naidan
collection PubMed
description Noncognitive constructs are commonly assessed in educational and organizational research. They are often measured by summing scores across items, which implicitly assumes a dominance item response process. However, research has shown that the unfolding response process may better characterize how people respond to noncognitive items. The Generalized Graded Unfolding Model (GGUM) representing the unfolding response process has therefore become increasingly popular. However, the current implementation of the GGUM is limited to unidimensional cases, while most noncognitive constructs are multidimensional. Fitting a unidimensional GGUM separately for each dimension and ignoring the multidimensional nature of noncognitive data may result in suboptimal parameter estimation. Recently, an R package bmggum was developed that enables the estimation of the Multidimensional Generalized Graded Unfolding Model (MGGUM) with covariates using a Bayesian algorithm. However, no simulation evidence is available to support the accuracy of the Bayesian algorithm implemented in bmggum. In this research, two simulation studies were conducted to examine the performance of bmggum. Results showed that bmggum can estimate MGGUM parameters accurately, and that multidimensional estimation and incorporating relevant covariates into the estimation process improved estimation accuracy. The effectiveness of two Bayesian model selection indices, WAIC and LOO, were also investigated and found to be satisfactory for model selection. Empirical data were used to demonstrate the use of bmggum and its performance was compared with three other GGUM software programs: GGUM2004, GGUM, and mirt.
format Online
Article
Text
id pubmed-10455612
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104556122023-08-26 Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach Tu, Naidan Zhang, Bo Angrave, Lawrence Sun, Tianjun Neuman, Mathew J Intell Article Noncognitive constructs are commonly assessed in educational and organizational research. They are often measured by summing scores across items, which implicitly assumes a dominance item response process. However, research has shown that the unfolding response process may better characterize how people respond to noncognitive items. The Generalized Graded Unfolding Model (GGUM) representing the unfolding response process has therefore become increasingly popular. However, the current implementation of the GGUM is limited to unidimensional cases, while most noncognitive constructs are multidimensional. Fitting a unidimensional GGUM separately for each dimension and ignoring the multidimensional nature of noncognitive data may result in suboptimal parameter estimation. Recently, an R package bmggum was developed that enables the estimation of the Multidimensional Generalized Graded Unfolding Model (MGGUM) with covariates using a Bayesian algorithm. However, no simulation evidence is available to support the accuracy of the Bayesian algorithm implemented in bmggum. In this research, two simulation studies were conducted to examine the performance of bmggum. Results showed that bmggum can estimate MGGUM parameters accurately, and that multidimensional estimation and incorporating relevant covariates into the estimation process improved estimation accuracy. The effectiveness of two Bayesian model selection indices, WAIC and LOO, were also investigated and found to be satisfactory for model selection. Empirical data were used to demonstrate the use of bmggum and its performance was compared with three other GGUM software programs: GGUM2004, GGUM, and mirt. MDPI 2023-08-14 /pmc/articles/PMC10455612/ /pubmed/37623546 http://dx.doi.org/10.3390/jintelligence11080163 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Tu, Naidan
Zhang, Bo
Angrave, Lawrence
Sun, Tianjun
Neuman, Mathew
Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title_full Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title_fullStr Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title_full_unstemmed Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title_short Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach
title_sort estimating the multidimensional generalized graded unfolding model with covariates using a bayesian approach
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10455612/
https://www.ncbi.nlm.nih.gov/pubmed/37623546
http://dx.doi.org/10.3390/jintelligence11080163
work_keys_str_mv AT tunaidan estimatingthemultidimensionalgeneralizedgradedunfoldingmodelwithcovariatesusingabayesianapproach
AT zhangbo estimatingthemultidimensionalgeneralizedgradedunfoldingmodelwithcovariatesusingabayesianapproach
AT angravelawrence estimatingthemultidimensionalgeneralizedgradedunfoldingmodelwithcovariatesusingabayesianapproach
AT suntianjun estimatingthemultidimensionalgeneralizedgradedunfoldingmodelwithcovariatesusingabayesianapproach
AT neumanmathew estimatingthemultidimensionalgeneralizedgradedunfoldingmodelwithcovariatesusingabayesianapproach