Design and use of vignettes to investigate referral decision-making by optometrists

PURPOSE: This study describes the design and application of a range of online clinical vignettes for measuring the impact of Continuing Education and Training (CET) and identifying unwarranted variation in optometric decision-making concerning referrals to secondary care. METHODS: Twenty computerised vignettes were developed to assess clinical and referral management decisions taken in primary care optometry. The online system was specifically designed to present vignettes (ten pre-CET and ten post-CET) that avoided prompting correct answers. The main study group was qualified optometrists (N = 31) who chose any CET options available to United Kingdom optometrists over six months. Participants submitted a record of the CET undertaken, which was compared with an anonymised General Optical Council (GOC) reference sample. The vignettes were also completed by newly-qualified (N = 18) and pre-registration (N = 11) groups. RESULTS: CET had no significant correlation (p = 0.37) with improvement in optometric clinical decision-making and referral practice (qualified group). Selection bias affected this group who had more CET points (p = 0.008) and peer discussion points (p = 0.003) than the GOC reference sample. Results were indicative due to small sample sizes. Newly-qualified practitioners were significantly more likely to refer than the qualified group (p = 0.004). Number of referrals decreased with time since qualification (p = 0.006). CONCLUSION: Computerised vignettes are a useful tool for comparing referral decisions between groups. Recruiting clinicians for time-consuming vignette studies is challenging. Strategies to reduce unwarranted variation in optometry, including support for newly-qualified optometrists, require further investigation.