Use of portfolios for assessment of global health residents: qualitative evaluation of design and implementation

BACKGROUND: When the Global Health training program was created at the University of Calgary, residents were encouraged to seek learning experiences that met their career goals and individualized objectives. An assessment tool was sought that could be reliable, valid, yet flexible. A portfolio process was chosen, but research was necessary to determine whether it was robust. METHODS: A qualitative study was conducted with academic experts in Canadian residency training, as well as directors and residents involved in Global Health study in order to assess the validity and benefit of such a tool. Through an online survey, interviews, and focus groups, views on the portfolio and intended content were collected and coded thematically. RESULTS: Multiple themes emerged from the content analysis. Overall, all stakeholders (residents and faculty) were supportive of the use of portfolios for summative assessment, mentioning authentic and varying assessments, reflective and narrative components, and mentor interaction as positive attributes, but they did have many recommendations. CONCLUSION: This qualitative evaluation validated the use of portfolios for this cohort of students while yielding comments and suggestions that will further enhance the interactive and flexible nature of this seldom used assessment tool. These findings contribute to the understanding of how Global Health assessment can remain individualized yet rigorous.