Capacity development in patient-oriented research: programme evaluation and impact analysis

BACKGROUND: National and provincial funding was invested to increase the quantity and quality of patient-oriented research (POR) across Canada. Capacity development became a priority to ensure all stakeholders were prepared to engage in POR. In part, this need was met through an annual Studentship competition in the province of Alberta, providing funding to students whose research incorporated principles of POR. However, despite efforts to build capacity in the health research trainee population, little is known about the outcomes of these programmes. This evaluation study examined the outcomes of a POR capacity development programme for health research trainees. METHODS: Final impact narrative reports were submitted by the 21 Studentship programme awardees for 2015 and 2016 who represent a variety of health disciplines across three major research universities. The reports describe the programme outcomes as well as the overall impact on individual, project and professional development as POR trainees. A synthesis of structured and categorised report data was conducted, along with additional qualitative analyses as new themes emerged that were not apparent in the competency framework utilised in the programme design. RESULTS: Awardee reports detailed the impact of the Studentship programme on the key themes of increased knowledge and skill, relationship building, confidence and leadership, as well as project and career impact. The impacts felt most profoundly by the awardees were not reflective of the competencies that guided programme design. The outcomes were then re-examined using a health research capacity development framework to gain a more comprehensive view of programme impact. CONCLUSION: The Studentship programme narratives provided insight into the rarely tracked capacity development outcomes of POR research trainees. Awardee narratives indicated significant development beyond the intended competencies and suggested a need to revisit the competency framework for POR in Alberta. While competencies were useful in guiding the design of the initial programme, a more comprehensive capacity development framework was required to capture the broader impacts on trainee development. Future capacity development programmes may benefit from these early programme insights, specifically the need for more robust competencies for POR. Further exploration of evaluation methods for short-term awards and sustainability of capacity development programmes is warranted.