SEIR models in the light of Critical Realism – A critique of exaggerated claims about the effectiveness of Covid 19 vaccinations

In a recent modeling study Watson et al. (Lancet Infect Dis 2022;3099:1-10) claim that Covid-19 vaccinations have helped to prevent roughly 14–20 million deaths in 2021. This conclusion is based on an epidemiological susceptible-exposed-infectious-recovered (SEIR) model trained on partially simulated data and yielding a reproduction number distribution which was then applied to a counterfactual scenario in which the efficacy of vaccinations was removed. Drawing on the meta-theory of Critical Realism, we point out several caveats of this model and caution against believing in its predictions. We argue that the absence of vaccinations would have significantly changed the causal tendencies of the system being modelled, yielding a different reproduction number than obtained from training the model on actually observed data. Furthermore, the model omits many important causal factors. Therefore this model, similar to many previous SEIR models, has oversimplified the complex interplay between biomedical, social and cultural dimensions of health and should not be used to guide public health policy. In order to predict the future in epidemic situations more accurately, continuously optimized dynamic causal models which can include the not directly tangible, yet real causal mechanisms affecting public health appear to be a promising alternative to SEIR-type models.