Cargando…

Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction

BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine l...

Descripción completa

Detalles Bibliográficos
Autores principales: Kunze, Kyle N., Polce, Evan M., Ranawat, Anil S., Randsborg, Per-Henrik, Williams, Riley J., Allen, Answorth A., Nwachukwu, Benedict U., Pearle, Andrew, Stein, Beth S., Dines, David, Kelly, Anne, Kelly, Bryan, Rose, Howard, Maynard, Michael, Strickland, Sabrina, Coleman, Struan, Hannafin, Jo, MacGillivray, John, Marx, Robert, Warren, Russell, Rodeo, Scott, Fealy, Stephen, O’Brien, Stephen, Wickiewicz, Thomas, Dines, Joshua S., Cordasco, Frank, Altcheck, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8521431/
https://www.ncbi.nlm.nih.gov/pubmed/34671691
http://dx.doi.org/10.1177/23259671211046575
_version_ 1784584899393486848
author Kunze, Kyle N.
Polce, Evan M.
Ranawat, Anil S.
Randsborg, Per-Henrik
Williams, Riley J.
Allen, Answorth A.
Nwachukwu, Benedict U.
Pearle, Andrew
Stein, Beth S.
Dines, David
Kelly, Anne
Kelly, Bryan
Rose, Howard
Maynard, Michael
Strickland, Sabrina
Coleman, Struan
Hannafin, Jo
MacGillivray, John
Marx, Robert
Warren, Russell
Rodeo, Scott
Fealy, Stephen
O’Brien, Stephen
Wickiewicz, Thomas
Dines, Joshua S.
Cordasco, Frank
Altcheck, David
author_facet Kunze, Kyle N.
Polce, Evan M.
Ranawat, Anil S.
Randsborg, Per-Henrik
Williams, Riley J.
Allen, Answorth A.
Nwachukwu, Benedict U.
Pearle, Andrew
Stein, Beth S.
Dines, David
Kelly, Anne
Kelly, Bryan
Rose, Howard
Maynard, Michael
Strickland, Sabrina
Coleman, Struan
Hannafin, Jo
MacGillivray, John
Marx, Robert
Warren, Russell
Rodeo, Scott
Fealy, Stephen
O’Brien, Stephen
Wickiewicz, Thomas
Dines, Joshua S.
Cordasco, Frank
Altcheck, David
author_sort Kunze, Kyle N.
collection PubMed
description BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine learning algorithms to predict achievement of the minimal clinically important difference (MCID) on the International Knee Documentation Committee (IKDC) score at a minimum 2-year follow-up after ACLR. STUDY DESIGN: Case-control study; Level of evidence, 3. METHODS: An ACLR registry of patients from 27 fellowship-trained sports medicine surgeons at a large academic institution was retrospectively analyzed. Thirty-six variables were tested for predictive value. The study population was randomly partitioned into training and independent testing sets using a 70:30 split. Six machine learning algorithms (stochastic gradient boosting, random forest, neural network, support vector machine, adaptive gradient boosting, and elastic-net penalized logistic regression [ENPLR]) were trained using 10-fold cross-validation 3 times and internally validated on the independent set of patients. Algorithm performance was assessed using discrimination, calibration, Brier score, and decision-curve analysis. RESULTS: A total of 442 patients, of whom 39 (8.8%) did not achieve the MCID, were included. The 5 most predictive features of achieving the MCID were body mass index ≤27.4, grade 0 medial collateral ligament examination (compared with other grades), intratunnel femoral tunnel fixation (compared with suspensory), no history of previous contralateral knee surgery, and achieving full knee extension preoperatively. The ENPLR algorithm had the best relative performance (C-statistic, 0.82; calibration intercept, 0.10; calibration slope, 1.15; Brier score, 0.068), demonstrating excellent predictive ability in the study’s data set. CONCLUSION: Machine learning, specifically the ENPLR algorithm, demonstrated good performance for predicting a patient’s propensity to achieve the MCID for the IKDC score after ACLR based on preoperative and intraoperative factors. The femoral tunnel fixation method was the only significant intraoperative variable. Range of motion and medial collateral ligament integrity were found to be important physical examination parameters. Increased body mass index and prior contralateral surgery were also significantly predictive of outcome.
format Online
Article
Text
id pubmed-8521431
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-85214312021-10-19 Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction Kunze, Kyle N. Polce, Evan M. Ranawat, Anil S. Randsborg, Per-Henrik Williams, Riley J. Allen, Answorth A. Nwachukwu, Benedict U. Pearle, Andrew Stein, Beth S. Dines, David Kelly, Anne Kelly, Bryan Rose, Howard Maynard, Michael Strickland, Sabrina Coleman, Struan Hannafin, Jo MacGillivray, John Marx, Robert Warren, Russell Rodeo, Scott Fealy, Stephen O’Brien, Stephen Wickiewicz, Thomas Dines, Joshua S. Cordasco, Frank Altcheck, David Orthop J Sports Med Article BACKGROUND: Understanding specific risk profiles for each patient and their propensity to experience clinically meaningful improvement after anterior cruciate ligament reconstruction (ACLR) is important for preoperative patient counseling and management of expectations. PURPOSE: To develop machine learning algorithms to predict achievement of the minimal clinically important difference (MCID) on the International Knee Documentation Committee (IKDC) score at a minimum 2-year follow-up after ACLR. STUDY DESIGN: Case-control study; Level of evidence, 3. METHODS: An ACLR registry of patients from 27 fellowship-trained sports medicine surgeons at a large academic institution was retrospectively analyzed. Thirty-six variables were tested for predictive value. The study population was randomly partitioned into training and independent testing sets using a 70:30 split. Six machine learning algorithms (stochastic gradient boosting, random forest, neural network, support vector machine, adaptive gradient boosting, and elastic-net penalized logistic regression [ENPLR]) were trained using 10-fold cross-validation 3 times and internally validated on the independent set of patients. Algorithm performance was assessed using discrimination, calibration, Brier score, and decision-curve analysis. RESULTS: A total of 442 patients, of whom 39 (8.8%) did not achieve the MCID, were included. The 5 most predictive features of achieving the MCID were body mass index ≤27.4, grade 0 medial collateral ligament examination (compared with other grades), intratunnel femoral tunnel fixation (compared with suspensory), no history of previous contralateral knee surgery, and achieving full knee extension preoperatively. The ENPLR algorithm had the best relative performance (C-statistic, 0.82; calibration intercept, 0.10; calibration slope, 1.15; Brier score, 0.068), demonstrating excellent predictive ability in the study’s data set. CONCLUSION: Machine learning, specifically the ENPLR algorithm, demonstrated good performance for predicting a patient’s propensity to achieve the MCID for the IKDC score after ACLR based on preoperative and intraoperative factors. The femoral tunnel fixation method was the only significant intraoperative variable. Range of motion and medial collateral ligament integrity were found to be important physical examination parameters. Increased body mass index and prior contralateral surgery were also significantly predictive of outcome. SAGE Publications 2021-10-14 /pmc/articles/PMC8521431/ /pubmed/34671691 http://dx.doi.org/10.1177/23259671211046575 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by-nc-nd/4.0/This article is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 License (https://creativecommons.org/licenses/by-nc-nd/4.0/) which permits non-commercial use, reproduction and distribution of the work as published without adaptation or alteration, without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Article
Kunze, Kyle N.
Polce, Evan M.
Ranawat, Anil S.
Randsborg, Per-Henrik
Williams, Riley J.
Allen, Answorth A.
Nwachukwu, Benedict U.
Pearle, Andrew
Stein, Beth S.
Dines, David
Kelly, Anne
Kelly, Bryan
Rose, Howard
Maynard, Michael
Strickland, Sabrina
Coleman, Struan
Hannafin, Jo
MacGillivray, John
Marx, Robert
Warren, Russell
Rodeo, Scott
Fealy, Stephen
O’Brien, Stephen
Wickiewicz, Thomas
Dines, Joshua S.
Cordasco, Frank
Altcheck, David
Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title_full Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title_fullStr Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title_full_unstemmed Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title_short Application of Machine Learning Algorithms to Predict Clinically Meaningful Improvement After Arthroscopic Anterior Cruciate Ligament Reconstruction
title_sort application of machine learning algorithms to predict clinically meaningful improvement after arthroscopic anterior cruciate ligament reconstruction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8521431/
https://www.ncbi.nlm.nih.gov/pubmed/34671691
http://dx.doi.org/10.1177/23259671211046575
work_keys_str_mv AT kunzekylen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT polceevanm applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT ranawatanils applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT randsborgperhenrik applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT williamsrileyj applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT allenanswortha applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT nwachukwubenedictu applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT pearleandrew applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT steinbeths applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT dinesdavid applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT kellyanne applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT kellybryan applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT rosehoward applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT maynardmichael applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT stricklandsabrina applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT colemanstruan applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT hannafinjo applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT macgillivrayjohn applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT marxrobert applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT warrenrussell applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT rodeoscott applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT fealystephen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT obrienstephen applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT wickiewiczthomas applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT dinesjoshuas applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT cordascofrank applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction
AT altcheckdavid applicationofmachinelearningalgorithmstopredictclinicallymeaningfulimprovementafterarthroscopicanteriorcruciateligamentreconstruction