A mixed-methods evaluation of the Tobacco Retailer Advanced Compliance (TRAC) online training (e-learning) program

INTRODUCTION: Tobacco vendor training is recognized as an essential element to reduce youth access to tobacco. The TRAC training program was developed utilizing best-practices in tobacco retailer training, adult instruction, and e-learning. The objective of this mixed-methods study is to evaluate the acceptability, usability and knowledge impact of an online tobacco retailer program. METHODS: An interview guide and evaluation questionnaire were used to collect data on usability and acceptability. To test learner knowledge, each module included a final set of 15 questions randomly chosen and posed to participants before and after the training. Content analysis, chi-squared tests, Student’s t-tests, and paired tests were utilized for data analysis. The evaluation was conducted in Alberta, Canada in 2020. RESULTS: A total of 128 participants enrolled in the study. The main themes revealed in the qualitative aspect of the evaluation were: the training was easy to navigate, engaging, informative, and beneficial to the staff’s daily work. Compared with the pre-training test, a significantly higher post-training test score, mean and (SD), was recorded for clerks who completed the clerk training module [59.1 (12.8) vs 75.5 (11.1), t=8.6378, p<0.001], and managers who completed the managers training module [51.5 (11.1) vs 73.1 (12.3), t=7.6446, p<0.001]. Similarly, a higher number of participants achieved the passing score of 80% in the post-training test in all three groups. CONCLUSIONS: The online training was found to be acceptable and effective in increasing the mean individual score in the knowledge test and in increasing the percentage of participants achieving the passing score. The TRAC training is the first known tobacco retailer training course to employ best practices in tobacco retailer training, adult instruction, and e-learning. Further evaluation of long-term outcomes on employee behavior and on overall compliance with tobacco legislation is recommended.