Cargando…

Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study

BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clini...

Descripción completa

Detalles Bibliográficos
Autores principales: Nowinka, Zuzanna, Alagha, M Abdulhadi, Mahmoud, Khadija, Jones, Gareth G
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9518113/
https://www.ncbi.nlm.nih.gov/pubmed/36099008
http://dx.doi.org/10.2196/36130
_version_ 1784799104298123264
author Nowinka, Zuzanna
Alagha, M Abdulhadi
Mahmoud, Khadija
Jones, Gareth G
author_facet Nowinka, Zuzanna
Alagha, M Abdulhadi
Mahmoud, Khadija
Jones, Gareth G
author_sort Nowinka, Zuzanna
collection PubMed
description BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clinicians in identifying patients at risk. Machine learning (ML) predictive models may offer a solution. We investigated whether ML models could predict the development of depression in patients with knee OA and examined which features are the most predictive. OBJECTIVE: The primary aim of this study was to develop and test an ML model to predict depression in patients with knee OA at 2 years and to validate the models using an external data set. The secondary aim was to identify the most important predictive features used by the ML algorithms. METHODS: Osteoarthritis Initiative Study (OAI) data were used for model development and external validation was performed using Multicenter Osteoarthritis Study (MOST) data. Forty-two features were selected, which denoted routinely collected demographic and clinical data such as patient demographics, past medical history, knee OA history, baseline examination findings, and patient-reported outcome measures. Six different ML classification models were trained (logistic regression, least absolute shrinkage and selection operator [LASSO], ridge regression, decision tree, random forest, and gradient boosting machine). The primary outcome was to predict depression at 2 years following study enrollment. The presence of depression was defined using the Center for Epidemiological Studies Depression Scale. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score. The most important features were extracted from the best-performing model on external validation. RESULTS: A total of 5947 patients were included in this study, with 2969 in the training set, 742 in the test set, and 2236 in the external validation set. For the test set, the AUC ranged from 0.673 (95% CI 0.604-0.742) to 0.869 (95% CI 0.824-0.913), with an F1 score of 0.435 to 0.490. On external validation, the AUC varied from 0.720 (95% CI 0.685-0.755) to 0.876 (95% CI 0.853-0.899), with an F1 score of 0.456 to 0.563. LASSO modeling offered the highest predictive performance. Blood pressure, baseline depression score, knee pain and stiffness, and quality of life were the most predictive features. CONCLUSIONS: To our knowledge, this is the first study to apply ML classification models to predict depression in patients with knee OA. Our study showed that ML models can deliver a clinically acceptable level of performance (AUC>0.7) in predicting the development of depression using routinely available demographic and clinical data. Further work is required to address the class imbalance in the training data and to evaluate the clinical utility of the models in facilitating early intervention and improved outcomes.
format Online
Article
Text
id pubmed-9518113
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-95181132022-09-29 Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study Nowinka, Zuzanna Alagha, M Abdulhadi Mahmoud, Khadija Jones, Gareth G JMIR Form Res Original Paper BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clinicians in identifying patients at risk. Machine learning (ML) predictive models may offer a solution. We investigated whether ML models could predict the development of depression in patients with knee OA and examined which features are the most predictive. OBJECTIVE: The primary aim of this study was to develop and test an ML model to predict depression in patients with knee OA at 2 years and to validate the models using an external data set. The secondary aim was to identify the most important predictive features used by the ML algorithms. METHODS: Osteoarthritis Initiative Study (OAI) data were used for model development and external validation was performed using Multicenter Osteoarthritis Study (MOST) data. Forty-two features were selected, which denoted routinely collected demographic and clinical data such as patient demographics, past medical history, knee OA history, baseline examination findings, and patient-reported outcome measures. Six different ML classification models were trained (logistic regression, least absolute shrinkage and selection operator [LASSO], ridge regression, decision tree, random forest, and gradient boosting machine). The primary outcome was to predict depression at 2 years following study enrollment. The presence of depression was defined using the Center for Epidemiological Studies Depression Scale. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score. The most important features were extracted from the best-performing model on external validation. RESULTS: A total of 5947 patients were included in this study, with 2969 in the training set, 742 in the test set, and 2236 in the external validation set. For the test set, the AUC ranged from 0.673 (95% CI 0.604-0.742) to 0.869 (95% CI 0.824-0.913), with an F1 score of 0.435 to 0.490. On external validation, the AUC varied from 0.720 (95% CI 0.685-0.755) to 0.876 (95% CI 0.853-0.899), with an F1 score of 0.456 to 0.563. LASSO modeling offered the highest predictive performance. Blood pressure, baseline depression score, knee pain and stiffness, and quality of life were the most predictive features. CONCLUSIONS: To our knowledge, this is the first study to apply ML classification models to predict depression in patients with knee OA. Our study showed that ML models can deliver a clinically acceptable level of performance (AUC>0.7) in predicting the development of depression using routinely available demographic and clinical data. Further work is required to address the class imbalance in the training data and to evaluate the clinical utility of the models in facilitating early intervention and improved outcomes. JMIR Publications 2022-09-13 /pmc/articles/PMC9518113/ /pubmed/36099008 http://dx.doi.org/10.2196/36130 Text en ©Zuzanna Nowinka, M Abdulhadi Alagha, Khadija Mahmoud, Gareth G Jones. Originally published in JMIR Formative Research (https://formative.jmir.org), 13.09.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.
spellingShingle Original Paper
Nowinka, Zuzanna
Alagha, M Abdulhadi
Mahmoud, Khadija
Jones, Gareth G
Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title_full Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title_fullStr Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title_full_unstemmed Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title_short Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
title_sort predicting depression in patients with knee osteoarthritis using machine learning: model development and validation study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9518113/
https://www.ncbi.nlm.nih.gov/pubmed/36099008
http://dx.doi.org/10.2196/36130
work_keys_str_mv AT nowinkazuzanna predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy
AT alaghamabdulhadi predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy
AT mahmoudkhadija predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy
AT jonesgarethg predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy