Cargando…

The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance

Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Min, Harbaugh, Allen G., Harring, Jeffrey R., Hancock, Gregory R.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5440768/
https://www.ncbi.nlm.nih.gov/pubmed/28588521
http://dx.doi.org/10.3389/fpsyg.2017.00726
_version_ 1783238123257331712
author Liu, Min
Harbaugh, Allen G.
Harring, Jeffrey R.
Hancock, Gregory R.
author_facet Liu, Min
Harbaugh, Allen G.
Harring, Jeffrey R.
Hancock, Gregory R.
author_sort Liu, Min
collection PubMed
description Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates obtained from analyzing a 2007 Trends in International Mathematics and Science Study data set, a population model was constructed. Original and contaminated data with one of two RSs were generated and analyzed via multi-group confirmatory factor analysis with different constraints of MI. The results indicated that the detrimental effects of response style on MI have been underestimated. More specifically, these two RSs had a substantially negative impact on both model fit and parameter recovery, suggesting that the lack of MI between groups may have been caused by the RSs, not the measured factors of focal interest. Practical implications are provided to help practitioners to detect RSs and determine whether RSs are a serious threat to MI.
format Online
Article
Text
id pubmed-5440768
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-54407682017-06-06 The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance Liu, Min Harbaugh, Allen G. Harring, Jeffrey R. Hancock, Gregory R. Front Psychol Psychology Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates obtained from analyzing a 2007 Trends in International Mathematics and Science Study data set, a population model was constructed. Original and contaminated data with one of two RSs were generated and analyzed via multi-group confirmatory factor analysis with different constraints of MI. The results indicated that the detrimental effects of response style on MI have been underestimated. More specifically, these two RSs had a substantially negative impact on both model fit and parameter recovery, suggesting that the lack of MI between groups may have been caused by the RSs, not the measured factors of focal interest. Practical implications are provided to help practitioners to detect RSs and determine whether RSs are a serious threat to MI. Frontiers Media S.A. 2017-05-23 /pmc/articles/PMC5440768/ /pubmed/28588521 http://dx.doi.org/10.3389/fpsyg.2017.00726 Text en Copyright © 2017 Liu, Harbaugh, Harring and Hancock. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Liu, Min
Harbaugh, Allen G.
Harring, Jeffrey R.
Hancock, Gregory R.
The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title_full The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title_fullStr The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title_full_unstemmed The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title_short The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
title_sort effect of extreme response and non-extreme response styles on testing measurement invariance
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5440768/
https://www.ncbi.nlm.nih.gov/pubmed/28588521
http://dx.doi.org/10.3389/fpsyg.2017.00726
work_keys_str_mv AT liumin theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT harbaughalleng theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT harringjeffreyr theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT hancockgregoryr theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT liumin effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT harbaughalleng effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT harringjeffreyr effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance
AT hancockgregoryr effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance