Cargando…
What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling
The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generatin...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5318383/ https://www.ncbi.nlm.nih.gov/pubmed/28270777 http://dx.doi.org/10.3389/fpsyg.2017.00126 |
_version_ | 1782509175595597824 |
---|---|
author | Koller, Ingrid Levenson, Michael R. Glück, Judith |
author_facet | Koller, Ingrid Levenson, Michael R. Glück, Judith |
author_sort | Koller, Ingrid |
collection | PubMed |
description | The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. |
format | Online Article Text |
id | pubmed-5318383 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-53183832017-03-07 What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling Koller, Ingrid Levenson, Michael R. Glück, Judith Front Psychol Psychology The valid measurement of latent constructs is crucial for psychological research. Here, we present a mixed-methods procedure for improving the precision of construct definitions, determining the content validity of items, evaluating the representativeness of items for the target construct, generating test items, and analyzing items on a theoretical basis. To illustrate the mixed-methods content-scaling-structure (CSS) procedure, we analyze the Adult Self-Transcendence Inventory, a self-report measure of wisdom (ASTI, Levenson et al., 2005). A content-validity analysis of the ASTI items was used as the basis of psychometric analyses using multidimensional item response models (N = 1215). We found that the new procedure produced important suggestions concerning five subdimensions of the ASTI that were not identifiable using exploratory methods. The study shows that the application of the suggested procedure leads to a deeper understanding of latent constructs. It also demonstrates the advantages of theory-based item analysis. Frontiers Media S.A. 2017-02-21 /pmc/articles/PMC5318383/ /pubmed/28270777 http://dx.doi.org/10.3389/fpsyg.2017.00126 Text en Copyright © 2017 Koller, Levenson and Glück. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Koller, Ingrid Levenson, Michael R. Glück, Judith What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title | What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title_full | What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title_fullStr | What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title_full_unstemmed | What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title_short | What Do You Think You Are Measuring? A Mixed-Methods Procedure for Assessing the Content Validity of Test Items and Theory-Based Scaling |
title_sort | what do you think you are measuring? a mixed-methods procedure for assessing the content validity of test items and theory-based scaling |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5318383/ https://www.ncbi.nlm.nih.gov/pubmed/28270777 http://dx.doi.org/10.3389/fpsyg.2017.00126 |
work_keys_str_mv | AT kolleringrid whatdoyouthinkyouaremeasuringamixedmethodsprocedureforassessingthecontentvalidityoftestitemsandtheorybasedscaling AT levensonmichaelr whatdoyouthinkyouaremeasuringamixedmethodsprocedureforassessingthecontentvalidityoftestitemsandtheorybasedscaling AT gluckjudith whatdoyouthinkyouaremeasuringamixedmethodsprocedureforassessingthecontentvalidityoftestitemsandtheorybasedscaling |