Cargando…

Investigating the Applicability of Alignment—A Monte Carlo Simulation Study

Traditional multiple-group confirmatory factor analysis (multiple-group CFA) is usually criticized for having too restrictive model assumption, namely the scalar measurement invariance. The new multiple-group analysis methodology, alignment, has become an effective alternative. The alignment evaluat...

Descripción completa

Detalles Bibliográficos
Autores principales: Wen, Congcong, Hu, Feng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9263979/
https://www.ncbi.nlm.nih.gov/pubmed/35814060
http://dx.doi.org/10.3389/fpsyg.2022.845721
_version_ 1784742870228402176
author Wen, Congcong
Hu, Feng
author_facet Wen, Congcong
Hu, Feng
author_sort Wen, Congcong
collection PubMed
description Traditional multiple-group confirmatory factor analysis (multiple-group CFA) is usually criticized for having too restrictive model assumption, namely the scalar measurement invariance. The new multiple-group analysis methodology, alignment, has become an effective alternative. The alignment evaluates measurement invariance and more importantly, permits factor mean comparisons without requiring scalar invariance which is usually required in traditional multiple-group CFA. Some simulation studies and empirical studies have investigated the applicability of alignment under different conditions, but some areas remain unexplored. Based on the simulation studies of Asparouhov and Muthén and of Flake and McCoach, this current simulation study is broken into two sections. The first study investigates the minimal group sizes required for alignment in three-factor models. The second study compares the performance of multiple-group CFA, multiple-group exploratory structural equation model (multiple-group ESEM), and alignment by including different proportions and magnitudes of cross-loadings in the models. Study 1 shows that when the model has no noninvariant parameters, the alignment requires relatively lower group sizes. Explicitly, the minimal group size required for alignment was 250 when the amount of groups was three, the minimal group size was 150 when the amount of groups was nine, and 200 when the amount of groups was 15. When there are noninvariant parameters in the model and the amount of groups is low, a group size of 350 is a safe rule of thumb. When there are noninvariant parameters in the model and the amount of groups is high, a group size of 250 is required for trustworthy results. The magnitude of noninvariance and the noninvariance rate do not affect the minimal group size required for alignment. Study 2 shows that multiple-group CFA provides accurate factor mean estimates when each factor had 20% factor loading (1 factor loading) with small-sized cross-loading. Multiple-group ESEM provides accurate factor mean estimates when the magnitude of cross-loading is small or when each factor had 20% factor loading (1 factor loading) with medium-sized cross-loading. Alignment provides accurate factor mean estimates when there are only small-sized cross-loadings in the model. The parameter estimates, coverage rates and ratios of average standard error to standard deviation for each methodology are not influenced by the amount of groups. Recommendations are concluded for using multiple-group CFA, multiple-group ESEM, traditional alignment and aligned ESEM (AESEM) based on the results. Multiple-group CFA is more suitable for use when scalar invariance is established. Multiple-group ESEM works best when there are small-sized or only a few medium-sized cross-loadings in the model. Traditional alignment allows for small-sized cross-loadings and a few noninvariant parameters in the model. AESEM integrates the advantages of alignment and ESEM, can provide accurate estimates when noninvariant parameters and cross-loadings both exist in the model. Compared to multiple-group CFA, multiple-group ESEM, the alignment methodology performs well in more situations.
format Online
Article
Text
id pubmed-9263979
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-92639792022-07-09 Investigating the Applicability of Alignment—A Monte Carlo Simulation Study Wen, Congcong Hu, Feng Front Psychol Psychology Traditional multiple-group confirmatory factor analysis (multiple-group CFA) is usually criticized for having too restrictive model assumption, namely the scalar measurement invariance. The new multiple-group analysis methodology, alignment, has become an effective alternative. The alignment evaluates measurement invariance and more importantly, permits factor mean comparisons without requiring scalar invariance which is usually required in traditional multiple-group CFA. Some simulation studies and empirical studies have investigated the applicability of alignment under different conditions, but some areas remain unexplored. Based on the simulation studies of Asparouhov and Muthén and of Flake and McCoach, this current simulation study is broken into two sections. The first study investigates the minimal group sizes required for alignment in three-factor models. The second study compares the performance of multiple-group CFA, multiple-group exploratory structural equation model (multiple-group ESEM), and alignment by including different proportions and magnitudes of cross-loadings in the models. Study 1 shows that when the model has no noninvariant parameters, the alignment requires relatively lower group sizes. Explicitly, the minimal group size required for alignment was 250 when the amount of groups was three, the minimal group size was 150 when the amount of groups was nine, and 200 when the amount of groups was 15. When there are noninvariant parameters in the model and the amount of groups is low, a group size of 350 is a safe rule of thumb. When there are noninvariant parameters in the model and the amount of groups is high, a group size of 250 is required for trustworthy results. The magnitude of noninvariance and the noninvariance rate do not affect the minimal group size required for alignment. Study 2 shows that multiple-group CFA provides accurate factor mean estimates when each factor had 20% factor loading (1 factor loading) with small-sized cross-loading. Multiple-group ESEM provides accurate factor mean estimates when the magnitude of cross-loading is small or when each factor had 20% factor loading (1 factor loading) with medium-sized cross-loading. Alignment provides accurate factor mean estimates when there are only small-sized cross-loadings in the model. The parameter estimates, coverage rates and ratios of average standard error to standard deviation for each methodology are not influenced by the amount of groups. Recommendations are concluded for using multiple-group CFA, multiple-group ESEM, traditional alignment and aligned ESEM (AESEM) based on the results. Multiple-group CFA is more suitable for use when scalar invariance is established. Multiple-group ESEM works best when there are small-sized or only a few medium-sized cross-loadings in the model. Traditional alignment allows for small-sized cross-loadings and a few noninvariant parameters in the model. AESEM integrates the advantages of alignment and ESEM, can provide accurate estimates when noninvariant parameters and cross-loadings both exist in the model. Compared to multiple-group CFA, multiple-group ESEM, the alignment methodology performs well in more situations. Frontiers Media S.A. 2022-06-24 /pmc/articles/PMC9263979/ /pubmed/35814060 http://dx.doi.org/10.3389/fpsyg.2022.845721 Text en Copyright © 2022 Wen and Hu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Wen, Congcong
Hu, Feng
Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title_full Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title_fullStr Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title_full_unstemmed Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title_short Investigating the Applicability of Alignment—A Monte Carlo Simulation Study
title_sort investigating the applicability of alignment—a monte carlo simulation study
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9263979/
https://www.ncbi.nlm.nih.gov/pubmed/35814060
http://dx.doi.org/10.3389/fpsyg.2022.845721
work_keys_str_mv AT wencongcong investigatingtheapplicabilityofalignmentamontecarlosimulationstudy
AT hufeng investigatingtheapplicabilityofalignmentamontecarlosimulationstudy