Cargando…

Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment

Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern...

Descripción completa

Detalles Bibliográficos
Autores principales: Kraatz, Miriam, Sears, Lindsay E., Coberley, Carter R., Pope, James E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Mary Ann Liebert, Inc. 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4965702/
https://www.ncbi.nlm.nih.gov/pubmed/26674396
http://dx.doi.org/10.1089/pop.2015.0101
_version_ 1782445297873453056
author Kraatz, Miriam
Sears, Lindsay E.
Coberley, Carter R.
Pope, James E.
author_facet Kraatz, Miriam
Sears, Lindsay E.
Coberley, Carter R.
Pope, James E.
author_sort Kraatz, Miriam
collection PubMed
description Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern and flexible measurement paradigm, to form the basis of adaptive population well-being measurement. Adaptive testing allows survey questions to be administered selectively, thereby reducing the number of questions required of the participant. After the graded response model was fit to a sample of size N = 12,035, theta scores were estimated based on both the full-item bank and a simulation of Computerized Adaptive Testing (CAT). Comparisons of these 2 sets of score estimates with each other and of their correlations with external outcomes of job performance, absenteeism, and hospital admissions demonstrate that the CAT well-being scores maintain accuracy and validity. The simulation indicates that the average survey taker can expect a reduction in number of items administered during the CAT process of almost 50%. An increase in efficiency of this extent is of considerable value because of the time savings during the administration of the survey and the potential improvement of user experience, which in turn can help secure the success of a total population-based well-being improvement program. (Population Health Management 2016;19:284–290)
format Online
Article
Text
id pubmed-4965702
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Mary Ann Liebert, Inc.
record_format MEDLINE/PubMed
spelling pubmed-49657022016-08-10 Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment Kraatz, Miriam Sears, Lindsay E. Coberley, Carter R. Pope, James E. Popul Health Manag Original Articles Well-being is linked to important societal factors such as health care costs and productivity and has experienced a surge in development activity of both theories and measurement. This study builds on validation of the Well-Being 5 survey and for the first time applies Item Response Theory, a modern and flexible measurement paradigm, to form the basis of adaptive population well-being measurement. Adaptive testing allows survey questions to be administered selectively, thereby reducing the number of questions required of the participant. After the graded response model was fit to a sample of size N = 12,035, theta scores were estimated based on both the full-item bank and a simulation of Computerized Adaptive Testing (CAT). Comparisons of these 2 sets of score estimates with each other and of their correlations with external outcomes of job performance, absenteeism, and hospital admissions demonstrate that the CAT well-being scores maintain accuracy and validity. The simulation indicates that the average survey taker can expect a reduction in number of items administered during the CAT process of almost 50%. An increase in efficiency of this extent is of considerable value because of the time savings during the administration of the survey and the potential improvement of user experience, which in turn can help secure the success of a total population-based well-being improvement program. (Population Health Management 2016;19:284–290) Mary Ann Liebert, Inc. 2016-08-01 /pmc/articles/PMC4965702/ /pubmed/26674396 http://dx.doi.org/10.1089/pop.2015.0101 Text en © Miriam Kraatz et al., 2016; Published by Mary Ann Liebert, Inc. This Open Access article is distributed under the terms of the Creative Commons Attribution Noncommercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
spellingShingle Original Articles
Kraatz, Miriam
Sears, Lindsay E.
Coberley, Carter R.
Pope, James E.
Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title_full Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title_fullStr Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title_full_unstemmed Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title_short Adaptive Measurement of Well-Being: Maximizing Efficiency and Optimizing User Experience during Individual Assessment
title_sort adaptive measurement of well-being: maximizing efficiency and optimizing user experience during individual assessment
topic Original Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4965702/
https://www.ncbi.nlm.nih.gov/pubmed/26674396
http://dx.doi.org/10.1089/pop.2015.0101
work_keys_str_mv AT kraatzmiriam adaptivemeasurementofwellbeingmaximizingefficiencyandoptimizinguserexperienceduringindividualassessment
AT searslindsaye adaptivemeasurementofwellbeingmaximizingefficiencyandoptimizinguserexperienceduringindividualassessment
AT coberleycarterr adaptivemeasurementofwellbeingmaximizingefficiencyandoptimizinguserexperienceduringindividualassessment
AT popejamese adaptivemeasurementofwellbeingmaximizingefficiencyandoptimizinguserexperienceduringindividualassessment