Cargando…

Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions

AIMS: The aim of this study was to develop and evaluate machine-learning-based computerized adaptive tests (CATs) for the Oxford Hip Score (OHS), Oxford Knee Score (OKS), Oxford Shoulder Score (OSS), and the Oxford Elbow Score (OES) and its subscales. METHODS: We developed CAT algorithms for the OHS...

Descripción completa

Detalles Bibliográficos
Autores principales: Harrison, Conrad J., Plummer, Otho R., Dawson, Jill, Jenkinson, Crispin, Hunt, Audrey, Rodrigues, Jeremy N.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The British Editorial Society of Bone & Joint Surgery 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9626870/
https://www.ncbi.nlm.nih.gov/pubmed/36222103
http://dx.doi.org/10.1302/2633-1462.310.BJO-2022-0073.R1
_version_ 1784822826948100096
author Harrison, Conrad J.
Plummer, Otho R.
Dawson, Jill
Jenkinson, Crispin
Hunt, Audrey
Rodrigues, Jeremy N.
author_facet Harrison, Conrad J.
Plummer, Otho R.
Dawson, Jill
Jenkinson, Crispin
Hunt, Audrey
Rodrigues, Jeremy N.
author_sort Harrison, Conrad J.
collection PubMed
description AIMS: The aim of this study was to develop and evaluate machine-learning-based computerized adaptive tests (CATs) for the Oxford Hip Score (OHS), Oxford Knee Score (OKS), Oxford Shoulder Score (OSS), and the Oxford Elbow Score (OES) and its subscales. METHODS: We developed CAT algorithms for the OHS, OKS, OSS, overall OES, and each of the OES subscales, using responses to the full-length questionnaires and a machine-learning technique called regression tree learning. The algorithms were evaluated through a series of simulation studies, in which they aimed to predict respondents’ full-length questionnaire scores from only a selection of their item responses. In each case, the total number of items used by the CAT algorithm was recorded and CAT scores were compared to full-length questionnaire scores by mean, SD, score distribution plots, Pearson’s correlation coefficient, intraclass correlation (ICC), and the Bland-Altman method. Differences between CAT scores and full-length questionnaire scores were contextualized through comparison to the instruments’ minimal clinically important difference (MCID). RESULTS: The CAT algorithms accurately estimated 12-item questionnaire scores from between four and nine items. Scores followed a very similar distribution between CAT and full-length assessments, with the mean score difference ranging from 0.03 to 0.26 out of 48 points. Pearson’s correlation coefficient and ICC were 0.98 for each 12-item scale and 0.95 or higher for the OES subscales. In over 95% of cases, a patient’s CAT score was within five points of the full-length questionnaire score for each 12-item questionnaire. CONCLUSION: Oxford Hip Score, Oxford Knee Score, Oxford Shoulder Score, and Oxford Elbow Score (including separate subscale scores) CATs all markedly reduce the burden of items to be completed without sacrificing score accuracy. Cite this article: Bone Jt Open 2022;3(10):786–794.
format Online
Article
Text
id pubmed-9626870
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher The British Editorial Society of Bone & Joint Surgery
record_format MEDLINE/PubMed
spelling pubmed-96268702022-11-07 Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions Harrison, Conrad J. Plummer, Otho R. Dawson, Jill Jenkinson, Crispin Hunt, Audrey Rodrigues, Jeremy N. Bone Jt Open General Orthopaedics AIMS: The aim of this study was to develop and evaluate machine-learning-based computerized adaptive tests (CATs) for the Oxford Hip Score (OHS), Oxford Knee Score (OKS), Oxford Shoulder Score (OSS), and the Oxford Elbow Score (OES) and its subscales. METHODS: We developed CAT algorithms for the OHS, OKS, OSS, overall OES, and each of the OES subscales, using responses to the full-length questionnaires and a machine-learning technique called regression tree learning. The algorithms were evaluated through a series of simulation studies, in which they aimed to predict respondents’ full-length questionnaire scores from only a selection of their item responses. In each case, the total number of items used by the CAT algorithm was recorded and CAT scores were compared to full-length questionnaire scores by mean, SD, score distribution plots, Pearson’s correlation coefficient, intraclass correlation (ICC), and the Bland-Altman method. Differences between CAT scores and full-length questionnaire scores were contextualized through comparison to the instruments’ minimal clinically important difference (MCID). RESULTS: The CAT algorithms accurately estimated 12-item questionnaire scores from between four and nine items. Scores followed a very similar distribution between CAT and full-length assessments, with the mean score difference ranging from 0.03 to 0.26 out of 48 points. Pearson’s correlation coefficient and ICC were 0.98 for each 12-item scale and 0.95 or higher for the OES subscales. In over 95% of cases, a patient’s CAT score was within five points of the full-length questionnaire score for each 12-item questionnaire. CONCLUSION: Oxford Hip Score, Oxford Knee Score, Oxford Shoulder Score, and Oxford Elbow Score (including separate subscale scores) CATs all markedly reduce the burden of items to be completed without sacrificing score accuracy. Cite this article: Bone Jt Open 2022;3(10):786–794. The British Editorial Society of Bone & Joint Surgery 2022-10-10 /pmc/articles/PMC9626870/ /pubmed/36222103 http://dx.doi.org/10.1302/2633-1462.310.BJO-2022-0073.R1 Text en © 2022 Author(s) et al. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial No Derivatives (CC BY-NC-ND 4.0) licence, which permits the copying and redistribution of the work only, and provided the original author and source are credited. See https://creativecommons.org/licenses/by-nc-nd/4.0/
spellingShingle General Orthopaedics
Harrison, Conrad J.
Plummer, Otho R.
Dawson, Jill
Jenkinson, Crispin
Hunt, Audrey
Rodrigues, Jeremy N.
Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title_full Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title_fullStr Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title_full_unstemmed Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title_short Computerized adaptive testing for the Oxford Hip, Knee, Shoulder, and Elbow scores: accurate measurement from fewer, and more patient-focused, questions
title_sort computerized adaptive testing for the oxford hip, knee, shoulder, and elbow scores: accurate measurement from fewer, and more patient-focused, questions
topic General Orthopaedics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9626870/
https://www.ncbi.nlm.nih.gov/pubmed/36222103
http://dx.doi.org/10.1302/2633-1462.310.BJO-2022-0073.R1
work_keys_str_mv AT harrisonconradj computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions
AT plummerothor computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions
AT dawsonjill computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions
AT jenkinsoncrispin computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions
AT huntaudrey computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions
AT rodriguesjeremyn computerizedadaptivetestingfortheoxfordhipkneeshoulderandelbowscoresaccuratemeasurementfromfewerandmorepatientfocusedquestions