Evaluation of an online interactive Diabetes Needs Assessment Tool (DNAT) versus online self-directed learning: a randomised controlled trial

BACKGROUND: Methods for the dissemination, understanding and implementation of clinical guidelines need to be examined for their effectiveness to help doctors integrate guidelines into practice. The objective of this randomised controlled trial was to evaluate the effectiveness of an interactive online Diabetes Needs Assessment Tool (DNAT) (which constructs an e-learning curriculum based on individually identified knowledge gaps), compared with self-directed e-learning of diabetes guidelines. METHODS: Health professionals were randomised to a 4-month learning period and either given access to diabetes learning modules alone (control group) or DNAT plus learning modules (intervention group). Participants completed knowledge tests before and after learning (primary outcome), and surveys to assess the acceptability of the learning and changes to clinical practice (secondary outcomes). RESULTS: Sixty four percent (677/1054) of participants completed both knowledge tests. The proportion of nurses (5.4%) was too small for meaningful analysis so they were excluded. For the 650 doctors completing both tests, mean (SD) knowledge scores increased from 47.4% (12.6) to 66.8% (11.5) [intervention group (n = 321, 64%)] and 47.3% (12.9) to 67.8% (10.8) [control group (n = 329, 66%)], (ANCOVA p = 0.186). Both groups were satisfied with the usability and usefulness of the learning materials. Seventy seven percent (218/284) of the intervention group reported combining the DNAT with the recommended reading materials was "very useful"/"useful". The majority in both groups (184/287, 64.1% intervention group and 206/299, 68.9% control group) [95% CI for the difference (-2.8 to 12.4)] reported integrating the learning into their clinical practice. CONCLUSIONS: Both groups experienced a similar and significant improvement in knowledge. The learning materials were acceptable and participants incorporated the acquired knowledge into practice. TRIAL REGISTRATION: ISRCTN: ISRCTN67215088