Cargando…

60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia

BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective coho...

Descripción completa

Detalles Bibliográficos
Autores principales: Moc, Courtney, Shropshire, William, McDaneld, Patrick, Shelburne, Samuel A, Aitken, Samuel L
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8643720/
http://dx.doi.org/10.1093/ofid/ofab466.060
_version_ 1784609916731785216
author Moc, Courtney
Shropshire, William
McDaneld, Patrick
Shelburne, Samuel A
Aitken, Samuel L
Aitken, Samuel L
author_facet Moc, Courtney
Shropshire, William
McDaneld, Patrick
Shelburne, Samuel A
Aitken, Samuel L
Aitken, Samuel L
author_sort Moc, Courtney
collection PubMed
description BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective cohort study were to develop a decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with Escherichia coli (E. coli) bacteremia as well as to compare the predictive accuracy between the tools. METHODS: Adults age ≥ 18 years old with E. coli bacteremia at The University of Texas MD Anderson Cancer Center from 1/2018 to 12/2019 were included. Isolates recovered within 1 week from the same patient were excluded. The decision tree was constructed using classification and regression tree analysis, with a minimum node size of 10. The risk score was created using a multivariable logistic regression model derived by using stepwise variable selection with backward elimination at level 0.2. The decision tree and risk score statistical metrics were compared. RESULTS: A total of 629 E. coli isolates were screened, of which 580 isolates met criteria. Ceftriaxone-resistant (CRO-R) E. coli accounted for 36% of isolates. The machine learning-derived decision tree included 5 predictors whereas the logistic regression-derived risk score included 7 predictors. The risk score cutoff point of ≥ 5 points demonstrated the most optimized overall classification accuracy. The positive predictive value of the decision tree was higher than that of the risk score (88% vs 74%, respectively), but the area under the receiver operating characteristic curve and model accuracy of the risk score was higher than that of the decision tree (0.85 vs 0.73 and 82% vs 74%, respectively). Figure 1. Clinical Decision Tree [Image: see text] Table 1. Regression Model and Assigned Points for Clinical Risk Score [Image: see text] Table 2. Statistical Metrics of Clinical Decision Tree and Clinical Risk Score [Image: see text] CONCLUSION: The decision tree and risk score can be used to determine the likelihood of whether a cancer patient with E. coli bacteremia has a CRO-R infection. In both clinical tools, the strongest predictor was a history of CRO-R E. coli colonization or infection in the last 6 months. The decision tree was more user-friendly, has fewer variables, and has a better positive predictive value in comparison to the risk score. However, the risk score has a significantly better discrimination and model accuracy than that of the decision tree. DISCLOSURES: Samuel L. Aitken, PharmD, MPH, BCIDP, Melinta Therapeutoics (Individual(s) Involved: Self): Consultant, Grant/Research Support
format Online
Article
Text
id pubmed-8643720
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-86437202021-12-06 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia Moc, Courtney Shropshire, William McDaneld, Patrick Shelburne, Samuel A Aitken, Samuel L Aitken, Samuel L Open Forum Infect Dis Oral Abstracts BACKGROUND: There are several clinical tools that have been developed to predict the likelihood of extended-spectrum β-lactamase producing Enterobacterales; however, the creation of these tools included few patients with cancer or otherwise immunosuppressed. The objectives of this retrospective cohort study were to develop a decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with Escherichia coli (E. coli) bacteremia as well as to compare the predictive accuracy between the tools. METHODS: Adults age ≥ 18 years old with E. coli bacteremia at The University of Texas MD Anderson Cancer Center from 1/2018 to 12/2019 were included. Isolates recovered within 1 week from the same patient were excluded. The decision tree was constructed using classification and regression tree analysis, with a minimum node size of 10. The risk score was created using a multivariable logistic regression model derived by using stepwise variable selection with backward elimination at level 0.2. The decision tree and risk score statistical metrics were compared. RESULTS: A total of 629 E. coli isolates were screened, of which 580 isolates met criteria. Ceftriaxone-resistant (CRO-R) E. coli accounted for 36% of isolates. The machine learning-derived decision tree included 5 predictors whereas the logistic regression-derived risk score included 7 predictors. The risk score cutoff point of ≥ 5 points demonstrated the most optimized overall classification accuracy. The positive predictive value of the decision tree was higher than that of the risk score (88% vs 74%, respectively), but the area under the receiver operating characteristic curve and model accuracy of the risk score was higher than that of the decision tree (0.85 vs 0.73 and 82% vs 74%, respectively). Figure 1. Clinical Decision Tree [Image: see text] Table 1. Regression Model and Assigned Points for Clinical Risk Score [Image: see text] Table 2. Statistical Metrics of Clinical Decision Tree and Clinical Risk Score [Image: see text] CONCLUSION: The decision tree and risk score can be used to determine the likelihood of whether a cancer patient with E. coli bacteremia has a CRO-R infection. In both clinical tools, the strongest predictor was a history of CRO-R E. coli colonization or infection in the last 6 months. The decision tree was more user-friendly, has fewer variables, and has a better positive predictive value in comparison to the risk score. However, the risk score has a significantly better discrimination and model accuracy than that of the decision tree. DISCLOSURES: Samuel L. Aitken, PharmD, MPH, BCIDP, Melinta Therapeutoics (Individual(s) Involved: Self): Consultant, Grant/Research Support Oxford University Press 2021-12-04 /pmc/articles/PMC8643720/ http://dx.doi.org/10.1093/ofid/ofab466.060 Text en © The Author(s) 2021. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Oral Abstracts
Moc, Courtney
Shropshire, William
McDaneld, Patrick
Shelburne, Samuel A
Aitken, Samuel L
Aitken, Samuel L
60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title_full 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title_fullStr 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title_full_unstemmed 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title_short 60. Creation and Comparison of a Machine Learning Decision Tree and Traditional Risk Score to Predict Ceftriaxone Resistance in Cancer Patients with E. coli Bacteremia
title_sort 60. creation and comparison of a machine learning decision tree and traditional risk score to predict ceftriaxone resistance in cancer patients with e. coli bacteremia
topic Oral Abstracts
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8643720/
http://dx.doi.org/10.1093/ofid/ofab466.060
work_keys_str_mv AT moccourtney 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia
AT shropshirewilliam 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia
AT mcdaneldpatrick 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia
AT shelburnesamuela 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia
AT aitkensamuell 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia
AT aitkensamuell 60creationandcomparisonofamachinelearningdecisiontreeandtraditionalriskscoretopredictceftriaxoneresistanceincancerpatientswithecolibacteremia