Cargando…

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education

PURPOSE: Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residen...

Descripción completa

Detalles Bibliográficos
Autores principales: Matava, Clyde T., Alam, Fahad, Kealey, Alayne, Bahrey, Lisa A., McCreath, Graham A., Walsh, Catharine M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10171726/
https://www.ncbi.nlm.nih.gov/pubmed/37165126
http://dx.doi.org/10.1007/s12630-023-02454-x
_version_ 1785039483797766144
author Matava, Clyde T.
Alam, Fahad
Kealey, Alayne
Bahrey, Lisa A.
McCreath, Graham A.
Walsh, Catharine M.
author_facet Matava, Clyde T.
Alam, Fahad
Kealey, Alayne
Bahrey, Lisa A.
McCreath, Graham A.
Walsh, Catharine M.
author_sort Matava, Clyde T.
collection PubMed
description PURPOSE: Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system. METHODS: This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome—gender-based differences in entrustment ratings of residents on the ACEA and EPAs—was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored. RESULTS: In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender. CONCLUSION: We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s12630-023-02454-x.
format Online
Article
Text
id pubmed-10171726
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-101717262023-05-11 The influence of resident and faculty gender on assessments in anesthesia competency-based medical education Matava, Clyde T. Alam, Fahad Kealey, Alayne Bahrey, Lisa A. McCreath, Graham A. Walsh, Catharine M. Can J Anaesth Reports of Original Investigations PURPOSE: Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system. METHODS: This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome—gender-based differences in entrustment ratings of residents on the ACEA and EPAs—was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored. RESULTS: In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender. CONCLUSION: We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s12630-023-02454-x. Springer International Publishing 2023-05-10 /pmc/articles/PMC10171726/ /pubmed/37165126 http://dx.doi.org/10.1007/s12630-023-02454-x Text en © Canadian Anesthesiologists' Society 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Reports of Original Investigations
Matava, Clyde T.
Alam, Fahad
Kealey, Alayne
Bahrey, Lisa A.
McCreath, Graham A.
Walsh, Catharine M.
The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title_full The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title_fullStr The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title_full_unstemmed The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title_short The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
title_sort influence of resident and faculty gender on assessments in anesthesia competency-based medical education
topic Reports of Original Investigations
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10171726/
https://www.ncbi.nlm.nih.gov/pubmed/37165126
http://dx.doi.org/10.1007/s12630-023-02454-x
work_keys_str_mv AT matavaclydet theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT alamfahad theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT kealeyalayne theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT bahreylisaa theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT mccreathgrahama theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT walshcatharinem theinfluenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT matavaclydet influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT alamfahad influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT kealeyalayne influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT bahreylisaa influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT mccreathgrahama influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation
AT walshcatharinem influenceofresidentandfacultygenderonassessmentsinanesthesiacompetencybasedmedicaleducation