Bayesian Model Averaging with Change Points to Assess the Impact of Vaccination and Public Health Interventions

BACKGROUND: Pneumococcal conjugate vaccines (PCVs) prevent invasive pneumococcal disease and pneumonia. However, some low-and middle-income countries have yet to introduce PCV into their immunization programs due, in part, to lack of certainty about the potential impact. Assessing PCV benefits is challenging because specific data on pneumococcal disease are often lacking, and it can be difficult to separate the effects of factors other than the vaccine that could also affect pneumococcal disease rates. METHODS: We assess PCV impact by combining Bayesian model averaging with change-point models to estimate the timing and magnitude of vaccine-associated changes, while controlling for seasonality and other covariates. We applied our approach to monthly time series of age-stratified hospitalizations related to pneumococcal infection in children younger 5 years of age in the United States, Brazil, and Chile. RESULTS: Our method accurately detected changes in data in which we knew true and noteworthy changes occurred, i.e., in simulated data and for invasive pneumococcal disease. Moreover, 24 months after the vaccine introduction, we detected reductions of 14%, 9%, and 9% in the United States, Brazil, and Chile, respectively, in all-cause pneumonia (ACP) hospitalizations for age group 0 to <1 years of age. CONCLUSIONS: Our approach provides a flexible and sensitive method to detect changes in disease incidence that occur after the introduction of a vaccine or other intervention, while avoiding biases that exist in current approaches to time-trend analyses.