Cargando…
Process and outcome evaluation of a CBME intervention guided by program theory
RATIONALE: Competency‐based medical education (CBME) has gained momentum as an improved training model, but literature on outcomes of CBME, including evaluation of implementation processes, is minimal. We present a case for the following: (a) the development of a program theory is essential prior to...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley & Sons, Inc.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7496603/ https://www.ncbi.nlm.nih.gov/pubmed/31927788 http://dx.doi.org/10.1111/jep.13344 |
_version_ | 1783583134414012416 |
---|---|
author | Hamza, Deena M. Ross, Shelley Oandasan, Ivy |
author_facet | Hamza, Deena M. Ross, Shelley Oandasan, Ivy |
author_sort | Hamza, Deena M. |
collection | PubMed |
description | RATIONALE: Competency‐based medical education (CBME) has gained momentum as an improved training model, but literature on outcomes of CBME, including evaluation of implementation processes, is minimal. We present a case for the following: (a) the development of a program theory is essential prior to or in the initial stages of implementation of CBME; (b) the program theory should guide the strategies and methods for evaluation that will answer questions about anticipated and unintended outcomes; and (c) the iterative process of testing assumptions and hypotheses will lead to modifications to the program theory to inform best practices of implementing CBME. METHODS: We use the Triple C Competency‐based Curriculum as a worked example to illustrate how process and outcome evaluation, guided by a program theory, can lead to meaningful enhancement of CBME curriculum, assessment, and implementation strategies. Using a mixed methods design, the processes and outcomes of Triple C were explored through surveys, interviews, and historical document review, which captured the experiences of various stakeholders. FINDINGS: The theory‐led program evaluation process was able to identify areas that supported CBME implementation: the value of a strong nondirective national vertical core supporting the transformation in education, program autonomy, and adaptability to pre‐existing local context. Areas in need of improvement included the need for ongoing support from College of Family Physicians of Canada (CFPC) and better planning for shifts in program leadership over time. CONCLUSIONS: Deliberately pairing evaluation alongside change is an important activity and, when accomplished, yields valuable information from the experiences of those implementing and experiencing a program. Evaluation and the development of an updated program theory facilitate the introduction of new changes and theories that build on these findings, which also supports the desired goal of contributing toward cumulative science rather than “reinventing the wheel.” |
format | Online Article Text |
id | pubmed-7496603 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | John Wiley & Sons, Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-74966032020-09-25 Process and outcome evaluation of a CBME intervention guided by program theory Hamza, Deena M. Ross, Shelley Oandasan, Ivy J Eval Clin Pract Special Issues RATIONALE: Competency‐based medical education (CBME) has gained momentum as an improved training model, but literature on outcomes of CBME, including evaluation of implementation processes, is minimal. We present a case for the following: (a) the development of a program theory is essential prior to or in the initial stages of implementation of CBME; (b) the program theory should guide the strategies and methods for evaluation that will answer questions about anticipated and unintended outcomes; and (c) the iterative process of testing assumptions and hypotheses will lead to modifications to the program theory to inform best practices of implementing CBME. METHODS: We use the Triple C Competency‐based Curriculum as a worked example to illustrate how process and outcome evaluation, guided by a program theory, can lead to meaningful enhancement of CBME curriculum, assessment, and implementation strategies. Using a mixed methods design, the processes and outcomes of Triple C were explored through surveys, interviews, and historical document review, which captured the experiences of various stakeholders. FINDINGS: The theory‐led program evaluation process was able to identify areas that supported CBME implementation: the value of a strong nondirective national vertical core supporting the transformation in education, program autonomy, and adaptability to pre‐existing local context. Areas in need of improvement included the need for ongoing support from College of Family Physicians of Canada (CFPC) and better planning for shifts in program leadership over time. CONCLUSIONS: Deliberately pairing evaluation alongside change is an important activity and, when accomplished, yields valuable information from the experiences of those implementing and experiencing a program. Evaluation and the development of an updated program theory facilitate the introduction of new changes and theories that build on these findings, which also supports the desired goal of contributing toward cumulative science rather than “reinventing the wheel.” John Wiley & Sons, Inc. 2020-01-11 2020-08 /pmc/articles/PMC7496603/ /pubmed/31927788 http://dx.doi.org/10.1111/jep.13344 Text en © 2020 The Authors. Journal of Evaluation in Clinical Practice published by John Wiley & Sons Ltd This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc-nd/4.0/ License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non‐commercial and no modifications or adaptations are made. |
spellingShingle | Special Issues Hamza, Deena M. Ross, Shelley Oandasan, Ivy Process and outcome evaluation of a CBME intervention guided by program theory |
title | Process and outcome evaluation of a CBME intervention guided by program theory |
title_full | Process and outcome evaluation of a CBME intervention guided by program theory |
title_fullStr | Process and outcome evaluation of a CBME intervention guided by program theory |
title_full_unstemmed | Process and outcome evaluation of a CBME intervention guided by program theory |
title_short | Process and outcome evaluation of a CBME intervention guided by program theory |
title_sort | process and outcome evaluation of a cbme intervention guided by program theory |
topic | Special Issues |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7496603/ https://www.ncbi.nlm.nih.gov/pubmed/31927788 http://dx.doi.org/10.1111/jep.13344 |
work_keys_str_mv | AT hamzadeenam processandoutcomeevaluationofacbmeinterventionguidedbyprogramtheory AT rossshelley processandoutcomeevaluationofacbmeinterventionguidedbyprogramtheory AT oandasanivy processandoutcomeevaluationofacbmeinterventionguidedbyprogramtheory |