Development and application of Adverse drug reactions reports QUality Algorithm (AQUA-12) score: a single-centre quality improvement initiative

PURPOSE: To develop a reliable assessment tool to monitor the quality of adverse drug reaction (ADR) reports and evaluate its performance within a quaternary hospital setting. METHODS: Adverse drug reactions report QUality Algorithm (AQUA-12) was developed by a multidisciplinary team with the expertise in the management of ADRs. The design was based on data elements required to establish medication causality. Inter-rater reliability of AQUA-12 was evaluated over three rounds in two phases: development and prospective evaluation phases, by independent assessors both internal and external to the institutional ADR review processes. The characteristics and quality of ADR reports were subsequently assessed, and potential factors contributing to low-quality reports were identified. RESULTS: A total of 70 ADR reports were assessed, 20 in development and 50 in evaluation phases. The inter-rater reliability of AQUA-12 was found to be excellent in all three rounds (Cronbach’s alpha of ≥ 0.9, p < 0.001 for all). Approximately one in five reports concerned immediate hypersensitivity reactions while delayed hypersensitivity reactions constituted 60% of all reactions. AQUA-12 identified 18 (25.7%) reports as ‘low-quality’ with a score of < 10. Identification of suspected medications (37.1%), description of index ADR (27.1%), and key events (ADR narrative, 35.7%) were the top data elements incomplete or missing from all reports. Univariable analyses identified the severity of the reaction as a factor associated with low quality of reports (p = 0.008). CONCLUSIONS: AQUA-12 is a practical and highly reliable assessment tool that can be utilised in hospital settings to regularly monitor the completeness of ADR reports to guide quality improvement initiatives.