Cargando…

2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates

BACKGROUND: Clostridium difficile infections (CDIs) are the most common type of healthcare-associated infection in the United States, with an estimated annual incidence of 500,000 cases and excess healthcare costs of $5 billion per year. The prevalence and severity of CDIs have been increasing in re...

Descripción completa

Detalles Bibliográficos
Autores principales: Nehls, Nicole, Bilantuono, Anthony, Etherton, Christian, Ilieş, Iulian, Benneyan, James C, Baker, Arthur W, Anderson, Deverick J
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6810319/
http://dx.doi.org/10.1093/ofid/ofz360.2104
_version_ 1783462221884424192
author Nehls, Nicole
Bilantuono, Anthony
Etherton, Christian
Ilieş, Iulian
Benneyan, James C
Baker, Arthur W
Anderson, Deverick J
author_facet Nehls, Nicole
Bilantuono, Anthony
Etherton, Christian
Ilieş, Iulian
Benneyan, James C
Baker, Arthur W
Anderson, Deverick J
author_sort Nehls, Nicole
collection PubMed
description BACKGROUND: Clostridium difficile infections (CDIs) are the most common type of healthcare-associated infection in the United States, with an estimated annual incidence of 500,000 cases and excess healthcare costs of $5 billion per year. The prevalence and severity of CDIs have been increasing in recent years, making it of vital importance to detect outbreaks sufficiently early to minimize negative health outcomes. Statistical process control (SPC) methods have proven to be a versatile tool in healthcare, enabling near real-time monitoring of adverse events rates and thereby improving patients’ health. The aim of this study was to investigate the performance of SPC in detecting clinically significant increases in CDI rates. METHODS: We retrospectively analyzed monthly CDI rates at 6 community hospitals in the Duke Infection Control Outreach Network from 2009–2017. Detected CDIs were stratified by surveillance system (LabID or traditional), infection source, recurrence type, and diagnostic test (nucleic acid amplification or enzyme-linked immunosorbent assay). Recurrent and community-associated CDIs were excluded from all analyses. Several variations of Shewhart and exponentially-weighted moving average (EWMA) u-charts were applied to each hospital (Figure 1), including using different baseline types (global, fixed, or rolling) and baseline data streams (hospital or network-wide). To help assess chart performance, epidemiologists determined the clinical relevance (yes/no) of 167 statistical signals generated using earlier iterations of these charts. Performance was quantified via sensitivity, specificity, and accuracy. RESULTS: EWMA u-charts with global network-wide baselines performed the best (Figure 2), detecting the largest number of clinically relevant signals (56% sensitivity) with high specificity (96%). Charts utilizing network-wide baselines were generally more accurate than those using local hospital data for that purpose (accuracy of 46–72% vs. 43–45%). Similarly, charts with fixed baselines performed better than those with rolling ones (accuracy of 43–62% vs. 43–47%). CONCLUSION: SPC charts are easily applicable to CDI surveillance; however, their parameters would need to be optimized to maximize utility. [Image: see text] [Image: see text] DISCLOSURES: All authors: No reported disclosures.
format Online
Article
Text
id pubmed-6810319
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-68103192019-10-28 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates Nehls, Nicole Bilantuono, Anthony Etherton, Christian Ilieş, Iulian Benneyan, James C Baker, Arthur W Anderson, Deverick J Open Forum Infect Dis Abstracts BACKGROUND: Clostridium difficile infections (CDIs) are the most common type of healthcare-associated infection in the United States, with an estimated annual incidence of 500,000 cases and excess healthcare costs of $5 billion per year. The prevalence and severity of CDIs have been increasing in recent years, making it of vital importance to detect outbreaks sufficiently early to minimize negative health outcomes. Statistical process control (SPC) methods have proven to be a versatile tool in healthcare, enabling near real-time monitoring of adverse events rates and thereby improving patients’ health. The aim of this study was to investigate the performance of SPC in detecting clinically significant increases in CDI rates. METHODS: We retrospectively analyzed monthly CDI rates at 6 community hospitals in the Duke Infection Control Outreach Network from 2009–2017. Detected CDIs were stratified by surveillance system (LabID or traditional), infection source, recurrence type, and diagnostic test (nucleic acid amplification or enzyme-linked immunosorbent assay). Recurrent and community-associated CDIs were excluded from all analyses. Several variations of Shewhart and exponentially-weighted moving average (EWMA) u-charts were applied to each hospital (Figure 1), including using different baseline types (global, fixed, or rolling) and baseline data streams (hospital or network-wide). To help assess chart performance, epidemiologists determined the clinical relevance (yes/no) of 167 statistical signals generated using earlier iterations of these charts. Performance was quantified via sensitivity, specificity, and accuracy. RESULTS: EWMA u-charts with global network-wide baselines performed the best (Figure 2), detecting the largest number of clinically relevant signals (56% sensitivity) with high specificity (96%). Charts utilizing network-wide baselines were generally more accurate than those using local hospital data for that purpose (accuracy of 46–72% vs. 43–45%). Similarly, charts with fixed baselines performed better than those with rolling ones (accuracy of 43–62% vs. 43–47%). CONCLUSION: SPC charts are easily applicable to CDI surveillance; however, their parameters would need to be optimized to maximize utility. [Image: see text] [Image: see text] DISCLOSURES: All authors: No reported disclosures. Oxford University Press 2019-10-23 /pmc/articles/PMC6810319/ http://dx.doi.org/10.1093/ofid/ofz360.2104 Text en © The Author(s) 2019. Published by Oxford University Press on behalf of Infectious Diseases Society of America. http://creativecommons.org/licenses/by-nc-nd/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial reproduction and distribution of the work, in any medium, provided the original work is not altered or transformed in any way, and that the work is properly cited. For commercial re-use, please contact journals.permissions@oup.com
spellingShingle Abstracts
Nehls, Nicole
Bilantuono, Anthony
Etherton, Christian
Ilieş, Iulian
Benneyan, James C
Baker, Arthur W
Anderson, Deverick J
2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title_full 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title_fullStr 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title_full_unstemmed 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title_short 2426. Performance of Statistical Process Control Charts for Detecting Clinically-Significant Increases in Clostridium difficile Infection Rates
title_sort 2426. performance of statistical process control charts for detecting clinically-significant increases in clostridium difficile infection rates
topic Abstracts
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6810319/
http://dx.doi.org/10.1093/ofid/ofz360.2104
work_keys_str_mv AT nehlsnicole 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT bilantuonoanthony 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT ethertonchristian 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT iliesiulian 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT benneyanjamesc 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT bakerarthurw 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates
AT andersondeverickj 2426performanceofstatisticalprocesscontrolchartsfordetectingclinicallysignificantincreasesinclostridiumdifficileinfectionrates