How well do coverage surveys and programmatically reported mass drug administration coverage match? Results from 214 mass drug administration campaigns in 15 countries, 2008–2017

INTRODUCTION: Delivering preventive chemotherapy through mass drug administration (MDA) is a central approach in controlling or eliminating several neglected tropical diseases (NTDs). Treatment coverage, a primary indicator of MDA performance, can be measured through routinely reported programmatic data or population-based coverage evaluation surveys. Reported coverage is often the easiest and least expensive way to estimate coverage; however, it is prone to inaccuracies due to errors in data compilation and imprecise denominators, and in some cases measures treatments offered as opposed to treatments swallowed. OBJECTIVE: Analyses presented here aimed to understand (1) how often coverage calculated using routinely reported data and survey data would lead programme managers to make the same programmatic decisions; (2) the magnitude and direction of the difference between these two estimates, and (3) whether there is meaningful variation by region, age group or country. METHODS: We analysed and compared reported and surveyed treatment coverage data from 214 MDAs implemented between 2008 and 2017 in 15 countries in Africa, Asia and the Caribbean. Routinely reported treatment coverage was compiled using data reported by national NTD programmes to donors, either directly or via NTD implementing partners, following the implementation of a district-level MDA campaign; coverage was calculated by dividing the number of individuals treated by a population value, which is typically based on national census projections and occasionally community registers. Surveyed treatment coverage came from post-MDA community-based coverage evaluation surveys, which were conducted as per standardised WHO recommended methodology. RESULTS: Coverage estimates using routine reporting and surveys gave the same result in terms of whether the minimum coverage threshold was reached in 72% of the MDAs surveyed in the Africa region and in 52% in the Asia region. The reported coverage value was within ±10 percentage points of the surveyed coverage value in 58/124 of the surveyed MDAs in the Africa region and 19/77 in the Asia region. Concordance between routinely reported and surveyed coverage estimates was 64% for the total population and 72% for school-age children. The study data showed variation across countries in the number of surveys conducted as well as the frequency with which there was concordance between the two coverage estimates. CONCLUSIONS: Programme managers must grapple with making decisions based on imperfect information, balancing needs for accuracy with cost and available capacity. The study shows that for many of the MDAs surveyed, based on the concordance with respect to reaching the minimum coverage thresholds, the routinely reported data were accurate enough to make programmatic decisions. Where coverage surveys do show a need to improve accuracy of routinely reported results, NTD programme managers should use various tools and approaches to strengthen data quality in order to use data for decision-making to achieve NTD control and elimination goals.