Effect of specificity of health expenditure questions in the measurement of out-of-pocket health expenditure: evidence from field experimental study in Ghana

BACKGROUND: The effect of number of health items on out-of-pockets (OOPs) has been identified as a source of bias in measuring OOPs. Evidence comes mostly from cross-sectional comparison of different survey instruments to collect data on OOPs. Very few studies have attempted to validate these questionnaires, or distinguish bias arising from the comprehensiveness of the OOPs list versus specificity of OOPs questions. OBJECTIVES: This study aims to estimate biases arising from the specificity of OOPs questions by comparing provider and household’s information. METHODS: A generic questionnaire to collect data on household’s OOPs was developed following the nomenclature proposed in division 6 of the classification of household final consumption 2018. The four categories within such division are used to set the comprehensiveness of the OOPs list, the specificity within each category was tailored to the design of the nationally representative living standard survey in Ghana where a field experiment was conducted to test the validity of different versions. Households were randomised to 11, 44 or 56 health items. Using data from provider records as the gold standard, we compared the mean positive OOPs, and estimated the mean ratio and variability in the ratio of household expenditures to provider data for the individual households using the Bland-Altman method of assessing agreement. FINDINGS: We found evidence of a difference in the overall mean ratio in the specificity for OOPs in inpatient care and medications. Within each of these two categories, a more detailed disaggregation yielded lower OOPs estimates than less detailed ones. The level of agreement between household and provider OOPs also decreased with increasing specificity of health items. CONCLUSION: Our findings suggest that, for inpatient care and medications, systematically decomposing OOPs categories into finer subclasses tend to produce lower OOPs estimates. Less detailed items produced more accurate and reliable OOPs estimates in the context of a rural setting.