Process evaluation of a web-based intervention aimed at empowerment of disability benefit claimants

BACKGROUND: The objective of this process evaluation study was to gain insight into the reach, compliance, appreciation, usage barriers, and users' perceived effectiveness of a web-based intervention http://www.wiagesprek.nl. This intervention was aimed at empowerment of disability claimants, prior to the assessment of disability by an insurance physician. METHODS: Reach was determined by registering claimants exposed to the study's invitation brochures, and by comparing trial participant characteristics with non-participants and nationwide claimant data. Compliance was registered by analyzing weblogs, which were automatically collected during the period of the trial. This made it possible to analyze individual use of the intervention. Appreciation, usage barriers, and users' perceived effectiveness were assessed using an online questionnaire that was sent to participants from the intervention group, 6 weeks after enrolment. RESULTS: Only 9% of the target population enrolled in the internet program. Because of selective enrolment, more females, higher educated claimants, and less ethnical minorities were reached. Compliance was ambiguous: out of the 123 participants randomized into the intervention group, a significant proportion (33%) did not use the intervention at all, while, at the same time, many participants (32%) used the intervention for more than two hours (i.e. in approximately two weeks). Overall satisfaction with the intervention was good. Claimants perceived the intervention most effective in increasing knowledge, while also a fair amount of users perceived the intervention effective in gaining right expectations or being able to communicate better with their physician. CONCLUSIONS: The uptake of the intervention http://www.wiagesprek.nl was disappointing. Specifically, the poor reach and compliance of the intervention resulted in a small proportion of the target population using the intervention as intended. Improvements in the implementation process are desirable to increase the reach and compliance and, thereby possibly, the impact of the intervention. TRIAL REGISTRATION: NTR-1414