Cargando…
The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance
Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5440768/ https://www.ncbi.nlm.nih.gov/pubmed/28588521 http://dx.doi.org/10.3389/fpsyg.2017.00726 |
_version_ | 1783238123257331712 |
---|---|
author | Liu, Min Harbaugh, Allen G. Harring, Jeffrey R. Hancock, Gregory R. |
author_facet | Liu, Min Harbaugh, Allen G. Harring, Jeffrey R. Hancock, Gregory R. |
author_sort | Liu, Min |
collection | PubMed |
description | Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates obtained from analyzing a 2007 Trends in International Mathematics and Science Study data set, a population model was constructed. Original and contaminated data with one of two RSs were generated and analyzed via multi-group confirmatory factor analysis with different constraints of MI. The results indicated that the detrimental effects of response style on MI have been underestimated. More specifically, these two RSs had a substantially negative impact on both model fit and parameter recovery, suggesting that the lack of MI between groups may have been caused by the RSs, not the measured factors of focal interest. Practical implications are provided to help practitioners to detect RSs and determine whether RSs are a serious threat to MI. |
format | Online Article Text |
id | pubmed-5440768 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-54407682017-06-06 The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance Liu, Min Harbaugh, Allen G. Harring, Jeffrey R. Hancock, Gregory R. Front Psychol Psychology Extreme and non-extreme response styles (RSs) are prevalent in survey research using Likert-type scales. Their effects on measurement invariance (MI) in the context of confirmatory factor analysis are systematically investigated here via a Monte Carlo simulation study. Using the parameter estimates obtained from analyzing a 2007 Trends in International Mathematics and Science Study data set, a population model was constructed. Original and contaminated data with one of two RSs were generated and analyzed via multi-group confirmatory factor analysis with different constraints of MI. The results indicated that the detrimental effects of response style on MI have been underestimated. More specifically, these two RSs had a substantially negative impact on both model fit and parameter recovery, suggesting that the lack of MI between groups may have been caused by the RSs, not the measured factors of focal interest. Practical implications are provided to help practitioners to detect RSs and determine whether RSs are a serious threat to MI. Frontiers Media S.A. 2017-05-23 /pmc/articles/PMC5440768/ /pubmed/28588521 http://dx.doi.org/10.3389/fpsyg.2017.00726 Text en Copyright © 2017 Liu, Harbaugh, Harring and Hancock. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Liu, Min Harbaugh, Allen G. Harring, Jeffrey R. Hancock, Gregory R. The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title | The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title_full | The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title_fullStr | The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title_full_unstemmed | The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title_short | The Effect of Extreme Response and Non-extreme Response Styles on Testing Measurement Invariance |
title_sort | effect of extreme response and non-extreme response styles on testing measurement invariance |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5440768/ https://www.ncbi.nlm.nih.gov/pubmed/28588521 http://dx.doi.org/10.3389/fpsyg.2017.00726 |
work_keys_str_mv | AT liumin theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT harbaughalleng theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT harringjeffreyr theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT hancockgregoryr theeffectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT liumin effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT harbaughalleng effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT harringjeffreyr effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance AT hancockgregoryr effectofextremeresponseandnonextremeresponsestylesontestingmeasurementinvariance |