Cargando…
Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine l...
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
SAGE Publications
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8521431/ https://www.ncbi.nlm.nih.gov/pubmed/34671691 http://dx.doi.org/10.1177/23259671211046575 |
_version_ | 1784584899393486848 |
---|---|
author | Kunze, Kyle N. Polce, Evan M. Ranawat, Anil S. Randsborg, Per-Henrik Williams, Riley J. Allen, Answorth A. Nwachukwu, Benedict U. Pearle, Andrew Stein, Beth S. Dines, David Kelly, Anne Kelly, Bryan Rose, Howard Maynard, Michael Strickland, Sabrina Coleman, Struan Hannafin, Jo MacGillivray, John Marx, Robert Warren, Russell Rodeo, Scott Fealy, Stephen O’Brien, Stephen Wickiewicz, Thomas Dines, Joshua S. Cordasco, Frank Altcheck, David |
author_facet | Kunze, Kyle N. Polce, Evan M. Ranawat, Anil S. Randsborg, Per-Henrik Williams, Riley J. Allen, Answorth A. Nwachukwu, Benedict U. Pearle, Andrew Stein, Beth S. Dines, David Kelly, Anne Kelly, Bryan Rose, Howard Maynard, Michael Strickland, Sabrina Coleman, Struan Hannafin, Jo MacGillivray, John Marx, Robert Warren, Russell Rodeo, Scott Fealy, Stephen O’Brien, Stephen Wickiewicz, Thomas Dines, Joshua S. Cordasco, Frank Altcheck, David |
author_sort | Kunze, Kyle N. |
collection | PubMed |
description | BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine learning algorithms to predict achievement of the minimal clinically important difference (MCID) on the International Knee Documentation Committee (IKDC) score at a minimum 2-year follow-up after ACLR. STUDY DESIGN: Case-control study; Level of evidence, 3. METHODS: An ACLR registry of patients from 27 fellowship-trained sports medicine surgeons at a large academic institution was retrospectively analyzed. Thirty-six variables were tested for predictive value. The study population was randomly partitioned into training and independent testing sets using a 70:30 split. Six machine learning algorithms (stochastic gradient boosting, random forest, neural network, support vector machine, adaptive gradient boosting, and elastic-net penalized logistic regression [ENPLR]) were trained using 10-fold cross-validation 3 times and internally validated on the independent set of patients. Algorithm performance was assessed using discrimination, calibration, Brier score, and decision-curve analysis. RESULTS: A total of 442 patients, of whom 39 (8.8%) did not achieve the MCID, were included. The 5 most predictive features of achieving the MCID were body mass index ≤27.4, grade 0 medial collateral ligament examination (compared with other grades), intratunnel femoral tunnel fixation (compared with suspensory), no history of previous contralateral knee surgery, and achieving full knee extension preoperatively. The ENPLR algorithm had the best relative performance (C-statistic, 0.82; calibration intercept, 0.10; calibration slope, 1.15; Brier score, 0.068), demonstrating excellent predictive ability in the study’s data set. CONCLUSION: Machine learning, specifically the ENPLR algorithm, demonstrated good performance for predicting a patient’s propensity to achieve the MCID for the IKDC score after ACLR based on preoperative and intraoperative factors. The femoral tunnel fixation method was the only significant intraoperative variable. Range of motion and medial collateral ligament integrity were found to be important physical examination parameters. Increased body mass index and prior contralateral surgery were also significantly predictive of outcome. |
format | Online Article Text |
id | pubmed-8521431 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | SAGE Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-85214312021-10-19 Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction Kunze, Kyle N. Polce, Evan M. Ranawat, Anil S. Randsborg, Per-Henrik Williams, Riley J. Allen, Answorth A. Nwachukwu, Benedict U. Pearle, Andrew Stein, Beth S. Dines, David Kelly, Anne Kelly, Bryan Rose, Howard Maynard, Michael Strickland, Sabrina Coleman, Struan Hannafin, Jo MacGillivray, John Marx, Robert Warren, Russell Rodeo, Scott Fealy, Stephen O’Brien, Stephen Wickiewicz, Thomas Dines, Joshua S. Cordasco, Frank Altcheck, David Orthop J Sports Med Article BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine learning algorithms to predict achievement of the minimal clinically important difference (MCID) on the International Knee Documentation Committee (IKDC) score at a minimum 2-year follow-up after ACLR. STUDY DESIGN: Case-control study; Level of evidence, 3. METHODS: An ACLR registry of patients from 27 fellowship-trained sports medicine surgeons at a large academic institution was retrospectively analyzed. Thirty-six variables were tested for predictive value. The study population was randomly partitioned into training and independent testing sets using a 70:30 split. Six machine learning algorithms (stochastic gradient boosting, random forest, neural network, support vector machine, adaptive gradient boosting, and elastic-net penalized logistic regression [ENPLR]) were trained using 10-fold cross-validation 3 times and internally validated on the independent set of patients. Algorithm performance was assessed using discrimination, calibration, Brier score, and decision-curve analysis. RESULTS: A total of 442 patients, of whom 39 (8.8%) did not achieve the MCID, were included. The 5 most predictive features of achieving the MCID were body mass index ≤27.4, grade 0 medial collateral ligament examination (compared with other grades), intratunnel femoral tunnel fixation (compared with suspensory), no history of previous contralateral knee surgery, and achieving full knee extension preoperatively. The ENPLR algorithm had the best relative performance (C-statistic, 0.82; calibration intercept, 0.10; calibration slope, 1.15; Brier score, 0.068), demonstrating excellent predictive ability in the study’s data set. CONCLUSION: Machine learning, specifically the ENPLR algorithm, demonstrated good performance for predicting a patient’s propensity to achieve the MCID for the IKDC score after ACLR based on preoperative and intraoperative factors. The femoral tunnel fixation method was the only significant intraoperative variable. Range of motion and medial collateral ligament integrity were found to be important physical examination parameters. Increased body mass index and prior contralateral surgery were also significantly predictive of outcome. SAGE Publications 2021-10-14 /pmc/articles/PMC8521431/ /pubmed/34671691 http://dx.doi.org/10.1177/23259671211046575 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by-nc-nd/4.0/This article is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 License (https://creativecommons.org/licenses/by-nc-nd/4.0/) which permits non-commercial use, reproduction and distribution of the work as published without adaptation or alteration, without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
spellingShingle | Article Kunze, Kyle N. Polce, Evan M. Ranawat, Anil S. Randsborg, Per-Henrik Williams, Riley J. Allen, Answorth A. Nwachukwu, Benedict U. Pearle, Andrew Stein, Beth S. Dines, David Kelly, Anne Kelly, Bryan Rose, Howard Maynard, Michael Strickland, Sabrina Coleman, Struan Hannafin, Jo MacGillivray, John Marx, Robert Warren, Russell Rodeo, Scott Fealy, Stephen O’Brien, Stephen Wickiewicz, Thomas Dines, Joshua S. Cordasco, Frank Altcheck, David Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title | Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title_full | Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title_fullStr | Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title_full_unstemmed | Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title_short | Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction |
title_sort | application of machine learning algorithms to predict clinically meaningful improvement after arthroscopic anterior cruciate ligament reconstruction |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8521431/ https://www.ncbi.nlm.nih.gov/pubmed/34671691 http://dx.doi.org/10.1177/23259671211046575 |
work_keys_str_mv | AT kunzekylen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT polceevanm applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT ranawatanils applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT randsborgperhenrik applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT williamsrileyj applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT allenanswortha applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT nwachukwubenedictu applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT pearleandrew applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT steinbeths applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT dinesdavid applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT kellyanne applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT kellybryan applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT rosehoward applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT maynardmichael applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT stricklandsabrina applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT colemanstruan applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT hannafinjo applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT macgillivrayjohn applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT marxrobert applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT warrenrussell applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT rodeoscott applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT fealystephen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT obrienstephen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT wickiewiczthomas applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT dinesjoshuas applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT cordascofrank applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction AT altcheckdavid applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction |