Towards quality criteria for regional public health reporting: concept mapping with Dutch experts

Background: In the Netherlands, municipal health assessments are carried out by 28 Regional Health Services, serving 418 municipalities. In the absence of guidelines, regional public health reports were developed in two pilot regions on the basis of the model and experience of national health reporting. Though they were well received and positively evaluated, it was not clear which specific characteristics determined ‘good public health reporting’. Therefore, this study was set up to develop a theoretical framework for the quality of regional public health reporting in The Netherlands. Methods: Using concept mapping as a standardized tool for conceptualization, 35 relevant reporting experts formulated short statements in two different brainstorming sessions, describing specific quality criteria of regional public health reports. After the removal of duplicates, the list was supplemented with international criteria, and the statements were sent to each participant for rating and sorting. The results were processed statistically and represented graphically. The output was discussed and interpreted, leading to the final concept map. Results: The final concept map consisted of 97 criteria, grouped into 13 clusters, and plotted in two dimensions: a ‘product’ dimension, ranging from ‘production’ to ‘content’, and a ‘context’ dimension, ranging from ‘science’ to ‘policy’. The three most important clusters were: (i) ‘solution orientation’, (ii) ‘policy relevance’ and (iii) ‘policy impact’. Conclusion: This study provided a theoretical framework for the quality of regional public health reporting, indicating relevant domains and criteria. Further work should translate domains and criteria into operational indicators for evaluating regional public health reports.