Cargando…

A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment

This paper describes a novel Long to Short approach that uses machine learning to develop efficient and convenient short assessments to approximate a long assessment. This approach is applicable to any assessments used to assess people’s behaviors, opinions, attitudes, mental and physical states, tr...

Descripción completa

Detalles Bibliográficos
Autores principales: Sun, Yuan Hong, Luo, Hong, Lee, Kang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729327/
https://www.ncbi.nlm.nih.gov/pubmed/35102519
http://dx.doi.org/10.3758/s13428-021-01771-7
_version_ 1784845466591035392
author Sun, Yuan Hong
Luo, Hong
Lee, Kang
author_facet Sun, Yuan Hong
Luo, Hong
Lee, Kang
author_sort Sun, Yuan Hong
collection PubMed
description This paper describes a novel Long to Short approach that uses machine learning to develop efficient and convenient short assessments to approximate a long assessment. This approach is applicable to any assessments used to assess people’s behaviors, opinions, attitudes, mental and physical states, traits, aptitudes, abilities, and mastery of a subject matter. We demonstrated the Long to Short approach on the Depression Anxiety Stress Scale (DASS-42) for assessing anxiety levels in adults. We first obtained data for the original assessment from a large sample of participants. We then derived the total scores from participants’ responses to all items of the long assessment as the ground truths. Next, we used feature selection techniques to select participants’ responses to a subset of items of the long assessment to predict the ground truths accurately. We then trained machine learning models that uses the minimal number of items needed to achieve the prediction accuracy similar to that when the responses to all items of the whole long assessment are used. We generated all possible combinations of minimal number of items to create multiple short assessments of similar predictive accuracies for use if the short assessment is to be done repeatedly. Finally, we implemented the short anxiety assessments in a web application for convenient use with any future participant of the assessment.
format Online
Article
Text
id pubmed-9729327
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-97293272022-12-09 A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment Sun, Yuan Hong Luo, Hong Lee, Kang Behav Res Methods Article This paper describes a novel Long to Short approach that uses machine learning to develop efficient and convenient short assessments to approximate a long assessment. This approach is applicable to any assessments used to assess people’s behaviors, opinions, attitudes, mental and physical states, traits, aptitudes, abilities, and mastery of a subject matter. We demonstrated the Long to Short approach on the Depression Anxiety Stress Scale (DASS-42) for assessing anxiety levels in adults. We first obtained data for the original assessment from a large sample of participants. We then derived the total scores from participants’ responses to all items of the long assessment as the ground truths. Next, we used feature selection techniques to select participants’ responses to a subset of items of the long assessment to predict the ground truths accurately. We then trained machine learning models that uses the minimal number of items needed to achieve the prediction accuracy similar to that when the responses to all items of the whole long assessment are used. We generated all possible combinations of minimal number of items to create multiple short assessments of similar predictive accuracies for use if the short assessment is to be done repeatedly. Finally, we implemented the short anxiety assessments in a web application for convenient use with any future participant of the assessment. Springer US 2022-01-31 2022 /pmc/articles/PMC9729327/ /pubmed/35102519 http://dx.doi.org/10.3758/s13428-021-01771-7 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Sun, Yuan Hong
Luo, Hong
Lee, Kang
A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title_full A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title_fullStr A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title_full_unstemmed A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title_short A Novel Approach for Developing Efficient and Convenient Short Assessments to Approximate a Long Assessment
title_sort novel approach for developing efficient and convenient short assessments to approximate a long assessment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9729327/
https://www.ncbi.nlm.nih.gov/pubmed/35102519
http://dx.doi.org/10.3758/s13428-021-01771-7
work_keys_str_mv AT sunyuanhong anovelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment
AT luohong anovelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment
AT leekang anovelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment
AT sunyuanhong novelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment
AT luohong novelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment
AT leekang novelapproachfordevelopingefficientandconvenientshortassessmentstoapproximatealongassessment