Cargando…
Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study
BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clini...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9518113/ https://www.ncbi.nlm.nih.gov/pubmed/36099008 http://dx.doi.org/10.2196/36130 |
_version_ | 1784799104298123264 |
---|---|
author | Nowinka, Zuzanna Alagha, M Abdulhadi Mahmoud, Khadija Jones, Gareth G |
author_facet | Nowinka, Zuzanna Alagha, M Abdulhadi Mahmoud, Khadija Jones, Gareth G |
author_sort | Nowinka, Zuzanna |
collection | PubMed |
description | BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clinicians in identifying patients at risk. Machine learning (ML) predictive models may offer a solution. We investigated whether ML models could predict the development of depression in patients with knee OA and examined which features are the most predictive. OBJECTIVE: The primary aim of this study was to develop and test an ML model to predict depression in patients with knee OA at 2 years and to validate the models using an external data set. The secondary aim was to identify the most important predictive features used by the ML algorithms. METHODS: Osteoarthritis Initiative Study (OAI) data were used for model development and external validation was performed using Multicenter Osteoarthritis Study (MOST) data. Forty-two features were selected, which denoted routinely collected demographic and clinical data such as patient demographics, past medical history, knee OA history, baseline examination findings, and patient-reported outcome measures. Six different ML classification models were trained (logistic regression, least absolute shrinkage and selection operator [LASSO], ridge regression, decision tree, random forest, and gradient boosting machine). The primary outcome was to predict depression at 2 years following study enrollment. The presence of depression was defined using the Center for Epidemiological Studies Depression Scale. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score. The most important features were extracted from the best-performing model on external validation. RESULTS: A total of 5947 patients were included in this study, with 2969 in the training set, 742 in the test set, and 2236 in the external validation set. For the test set, the AUC ranged from 0.673 (95% CI 0.604-0.742) to 0.869 (95% CI 0.824-0.913), with an F1 score of 0.435 to 0.490. On external validation, the AUC varied from 0.720 (95% CI 0.685-0.755) to 0.876 (95% CI 0.853-0.899), with an F1 score of 0.456 to 0.563. LASSO modeling offered the highest predictive performance. Blood pressure, baseline depression score, knee pain and stiffness, and quality of life were the most predictive features. CONCLUSIONS: To our knowledge, this is the first study to apply ML classification models to predict depression in patients with knee OA. Our study showed that ML models can deliver a clinically acceptable level of performance (AUC>0.7) in predicting the development of depression using routinely available demographic and clinical data. Further work is required to address the class imbalance in the training data and to evaluate the clinical utility of the models in facilitating early intervention and improved outcomes. |
format | Online Article Text |
id | pubmed-9518113 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-95181132022-09-29 Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study Nowinka, Zuzanna Alagha, M Abdulhadi Mahmoud, Khadija Jones, Gareth G JMIR Form Res Original Paper BACKGROUND: Knee osteoarthritis (OA) is the most common form of OA and a leading cause of disability worldwide. Chronic pain and functional loss secondary to knee OA put patients at risk of developing depression, which can also impair their treatment response. However, no tools exist to assist clinicians in identifying patients at risk. Machine learning (ML) predictive models may offer a solution. We investigated whether ML models could predict the development of depression in patients with knee OA and examined which features are the most predictive. OBJECTIVE: The primary aim of this study was to develop and test an ML model to predict depression in patients with knee OA at 2 years and to validate the models using an external data set. The secondary aim was to identify the most important predictive features used by the ML algorithms. METHODS: Osteoarthritis Initiative Study (OAI) data were used for model development and external validation was performed using Multicenter Osteoarthritis Study (MOST) data. Forty-two features were selected, which denoted routinely collected demographic and clinical data such as patient demographics, past medical history, knee OA history, baseline examination findings, and patient-reported outcome measures. Six different ML classification models were trained (logistic regression, least absolute shrinkage and selection operator [LASSO], ridge regression, decision tree, random forest, and gradient boosting machine). The primary outcome was to predict depression at 2 years following study enrollment. The presence of depression was defined using the Center for Epidemiological Studies Depression Scale. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC) and F1 score. The most important features were extracted from the best-performing model on external validation. RESULTS: A total of 5947 patients were included in this study, with 2969 in the training set, 742 in the test set, and 2236 in the external validation set. For the test set, the AUC ranged from 0.673 (95% CI 0.604-0.742) to 0.869 (95% CI 0.824-0.913), with an F1 score of 0.435 to 0.490. On external validation, the AUC varied from 0.720 (95% CI 0.685-0.755) to 0.876 (95% CI 0.853-0.899), with an F1 score of 0.456 to 0.563. LASSO modeling offered the highest predictive performance. Blood pressure, baseline depression score, knee pain and stiffness, and quality of life were the most predictive features. CONCLUSIONS: To our knowledge, this is the first study to apply ML classification models to predict depression in patients with knee OA. Our study showed that ML models can deliver a clinically acceptable level of performance (AUC>0.7) in predicting the development of depression using routinely available demographic and clinical data. Further work is required to address the class imbalance in the training data and to evaluate the clinical utility of the models in facilitating early intervention and improved outcomes. JMIR Publications 2022-09-13 /pmc/articles/PMC9518113/ /pubmed/36099008 http://dx.doi.org/10.2196/36130 Text en ©Zuzanna Nowinka, M Abdulhadi Alagha, Khadija Mahmoud, Gareth G Jones. Originally published in JMIR Formative Research (https://formative.jmir.org), 13.09.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Nowinka, Zuzanna Alagha, M Abdulhadi Mahmoud, Khadija Jones, Gareth G Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title | Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title_full | Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title_fullStr | Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title_full_unstemmed | Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title_short | Predicting Depression in Patients With Knee Osteoarthritis Using Machine Learning: Model Development and Validation Study |
title_sort | predicting depression in patients with knee osteoarthritis using machine learning: model development and validation study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9518113/ https://www.ncbi.nlm.nih.gov/pubmed/36099008 http://dx.doi.org/10.2196/36130 |
work_keys_str_mv | AT nowinkazuzanna predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy AT alaghamabdulhadi predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy AT mahmoudkhadija predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy AT jonesgarethg predictingdepressioninpatientswithkneeosteoarthritisusingmachinelearningmodeldevelopmentandvalidationstudy |