“Strengthening data quality and reporting from small-scale surveys in humanitarian settings: a case study from Yemen, 2011–2019”

BACKGROUND: Under-five death rate is one of the major indicators used in assessing the level of needs and severity of humanitarian crisis. Over the years, a number of small-scale surveys based on Standardized Monitoring and Assessment of Relief and Transitions methodology has been conducted in Yemen, these serve as a guide for policy maker and the humanitarian community. The aim of this study is to identify critical methodological and reporting weaknesses that are easy to correct and would improve substantively the quality of the results. METHODS: We obtained seventy-seven surveys conducted across 22 governorates in Yemen between 2011 and 2019 and divided the analysis period into pre-crisis (2011–2014) and crisis period (2015–2019) for comparison. We analysed survey qualities such as sampling methodology, completeness of reporting of Under-five death rate and mortality sample size for children less than five (children < 5) years old. RESULTS: Seventy-seven (71.9%) out of 107 surveys met the eligibility criteria to be included in the study. The methodological quality and reporting are as varied as the surveys. 23.4% (n = 18) met the criteria for quality of sampling methodology, while 77.9%(n = 60) presented required information for the estimation of required mortality sample size and 40.3%(n = 31) met the quality check for reporting of Under-five death rate. CONCLUSIONS: Our assessment indicated that there is no strict adherence to the sampling methodology set out in Standardized Monitoring and Assessment of Relief and Transitions guidelines, and reporting of mortality and sample size data. Adherence to methodological guidelines and complete reporting of surveys in humanitarian settings will vastly improve both the quality and uptake of key data on health and nutrition of the affected population. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13031-021-00369-2.