Cargando…
60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective coho...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8643720/ http://dx.doi.org/10.1093/ofid/ofab466.060 |
_version_ | 1784609916731785216 |
---|---|
author | Moc, Courtney Shropshire, William McDaneld, Patrick Shelburne, Samuel A Aitken, Samuel L Aitken, Samuel L |
author_facet | Moc, Courtney Shropshire, William McDaneld, Patrick Shelburne, Samuel A Aitken, Samuel L Aitken, Samuel L |
author_sort | Moc, Courtney |
collection | PubMed |
description | BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective cohort study were to develop a decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with Escherichia coli (E. coli) bacteremia as well as to compare the predictive accuracy between the tools. METHODS: Adults age ≥ 18 years old with E. coli bacteremia at The University of Texas MD Anderson Cancer Center from 1/2018 to 12/2019 were included. Isolates recovered within 1 week from the same patient were excluded. The decision tree was constructed using classification and regression tree analysis, with a minimum node size of 10. The risk score was created using a multivariable logistic regression model derived by using stepwise variable selection with backward elimination at level 0.2. The decision tree and risk score statistical metrics were compared. RESULTS: A total of 629 E. coli isolates were screened, of which 580 isolates met criteria. Ceftriaxone-resistant (CRO-R) E. coli accounted for 36% of isolates. The machine learning-derived decision tree included 5 predictors whereas the logistic regression-derived risk score included 7 predictors. The risk score cutoff point of ≥ 5 points demonstrated the most optimized overall classification accuracy. The positive predictive value of the decision tree was higher than that of the risk score (88% vs 74%, respectively), but the area under the receiver operating characteristic curve and model accuracy of the risk score was higher than that of the decision tree (0.85 vs 0.73 and 82% vs 74%, respectively). Figure 1. Clinical Decision Tree [Image: see text] Table 1. Regression Model and Assigned Points for Clinical Risk Score [Image: see text] Table 2. Statistical Metrics of Clinical Decision Tree and Clinical Risk Score [Image: see text] CONCLUSION: The decision tree and risk score can be used to determine the likelihood of whether a cancer patient with E. coli bacteremia has a CRO-R infection. In both clinical tools, the strongest predictor was a history of CRO-R E. coli colonization or infection in the last 6 months. The decision tree was more user-friendly, has fewer variables, and has a better positive predictive value in comparison to the risk score. However, the risk score has a significantly better discrimination and model accuracy than that of the decision tree. DISCLOSURES: Samuel L. Aitken, PharmD, MPH, BCIDP, Melinta Therapeutoics (Individual(s) Involved: Self): Consultant, Grant/Research Support |
format | Online Article Text |
id | pubmed-8643720 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-86437202021-12-06 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia Moc, Courtney Shropshire, William McDaneld, Patrick Shelburne, Samuel A Aitken, Samuel L Aitken, Samuel L Open Forum Infect Dis Oral Abstracts BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective cohort study were to develop a decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with Escherichia coli (E. coli) bacteremia as well as to compare the predictive accuracy between the tools. METHODS: Adults age ≥ 18 years old with E. coli bacteremia at The University of Texas MD Anderson Cancer Center from 1/2018 to 12/2019 were included. Isolates recovered within 1 week from the same patient were excluded. The decision tree was constructed using classification and regression tree analysis, with a minimum node size of 10. The risk score was created using a multivariable logistic regression model derived by using stepwise variable selection with backward elimination at level 0.2. The decision tree and risk score statistical metrics were compared. RESULTS: A total of 629 E. coli isolates were screened, of which 580 isolates met criteria. Ceftriaxone-resistant (CRO-R) E. coli accounted for 36% of isolates. The machine learning-derived decision tree included 5 predictors whereas the logistic regression-derived risk score included 7 predictors. The risk score cutoff point of ≥ 5 points demonstrated the most optimized overall classification accuracy. The positive predictive value of the decision tree was higher than that of the risk score (88% vs 74%, respectively), but the area under the receiver operating characteristic curve and model accuracy of the risk score was higher than that of the decision tree (0.85 vs 0.73 and 82% vs 74%, respectively). Figure 1. Clinical Decision Tree [Image: see text] Table 1. Regression Model and Assigned Points for Clinical Risk Score [Image: see text] Table 2. Statistical Metrics of Clinical Decision Tree and Clinical Risk Score [Image: see text] CONCLUSION: The decision tree and risk score can be used to determine the likelihood of whether a cancer patient with E. coli bacteremia has a CRO-R infection. In both clinical tools, the strongest predictor was a history of CRO-R E. coli colonization or infection in the last 6 months. The decision tree was more user-friendly, has fewer variables, and has a better positive predictive value in comparison to the risk score. However, the risk score has a significantly better discrimination and model accuracy than that of the decision tree. DISCLOSURES: Samuel L. Aitken, PharmD, MPH, BCIDP, Melinta Therapeutoics (Individual(s) Involved: Self): Consultant, Grant/Research Support Oxford University Press 2021-12-04 /pmc/articles/PMC8643720/ http://dx.doi.org/10.1093/ofid/ofab466.060 Text en © The Author(s) 2021. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Oral Abstracts Moc, Courtney Shropshire, William McDaneld, Patrick Shelburne, Samuel A Aitken, Samuel L Aitken, Samuel L 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title | 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title_full | 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title_fullStr | 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title_full_unstemmed | 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title_short | 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia |
title_sort | 60. creation and comparison of a machine learning decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with e. coli bacteremia |
topic | Oral Abstracts |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8643720/ http://dx.doi.org/10.1093/ofid/ofab466.060 |
work_keys_str_mv | AT moccourtney 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia AT shropshirewilliam 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia AT mcdaneldpatrick 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia AT shelburnesamuela 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia AT aitkensamuell 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia AT aitkensamuell 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia |