Cargando…

Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents

IMPORTANCE: Gender disparities exist throughout medicine. Recent studies have highlighted an attainment gap between male and female residents in performance evaluations on Accreditation Council for Graduate Medical Education (ACGME) milestones. Because of difficulties in blinding evaluators to gende...

Descripción completa

Detalles Bibliográficos
Autores principales: See, Ashley, Pallaci, Michael, Aluisio, Adam R., Beck-Esmay, Jenny, Menchine, Michael, Weinstock, Michael, Lam, Chun Nok, Riddell, Jeff
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Medical Association 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8822382/
https://www.ncbi.nlm.nih.gov/pubmed/35129594
http://dx.doi.org/10.1001/jamanetworkopen.2021.47351
_version_ 1784646597738496000
author See, Ashley
Pallaci, Michael
Aluisio, Adam R.
Beck-Esmay, Jenny
Menchine, Michael
Weinstock, Michael
Lam, Chun Nok
Riddell, Jeff
author_facet See, Ashley
Pallaci, Michael
Aluisio, Adam R.
Beck-Esmay, Jenny
Menchine, Michael
Weinstock, Michael
Lam, Chun Nok
Riddell, Jeff
author_sort See, Ashley
collection PubMed
description IMPORTANCE: Gender disparities exist throughout medicine. Recent studies have highlighted an attainment gap between male and female residents in performance evaluations on Accreditation Council for Graduate Medical Education (ACGME) milestones. Because of difficulties in blinding evaluators to gender, it remains unclear whether these observed disparities are because of implicit bias or other causes. OBJECTIVE: To estimate the magnitude of implicit gender bias in assessments of procedural competency in emergency medicine residents and whether the gender of the evaluator is associated with identified implicit gender bias. DESIGN, SETTING, AND PARTICIPANTS: A cross-sectional study was performed from 2018 to 2020 in which emergency medicine residency faculty assessed procedural competency by evaluating videos of residents performing 3 procedures in a simulated environment. They were blinded to the intent of the study. Proceduralists were filmed performing each procedure from 2 different viewpoints simultaneously by 2 different cameras. One was a gender-blinded (ie, hands-only) view, and the other a wide-angled gender-evident (ie, whole-body) view. The faculty evaluators viewed videos in a random order and assessed procedural competency on a global rating scale with extensive validity evidence for the evaluation of video-recorded procedural performance. MAIN OUTCOMES AND MEASURES: The primary outcome was to determine if there was a difference in the evaluation of procedural competency based on gender. The secondary outcome was to determine if there was a difference in the evaluations based on the gender of the evaluator. RESULTS: Fifty-one faculty evaluators enrolled from 19 states, with 22 male participants (43.1%), 29 female participants (56.9%), and a mean (SD) age of 37 (6.4) years. Each evaluator assessed all 60 procedures: 30 gender-blinded (hands-only view) videos and 30 identical gender-evident (wide angle) videos. There were no statistically significant differences in the study evaluators’ scores of the proceduralists based on their gender, and the gender of the evaluator was not associated with the difference in mean scores. CONCLUSIONS AND RELEVANCE: In this study, we did not identify a difference in the evaluation of procedural competency based upon the gender of the resident proceduralist or the gender of the faculty evaluator.
format Online
Article
Text
id pubmed-8822382
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher American Medical Association
record_format MEDLINE/PubMed
spelling pubmed-88223822022-02-17 Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents See, Ashley Pallaci, Michael Aluisio, Adam R. Beck-Esmay, Jenny Menchine, Michael Weinstock, Michael Lam, Chun Nok Riddell, Jeff JAMA Netw Open Original Investigation IMPORTANCE: Gender disparities exist throughout medicine. Recent studies have highlighted an attainment gap between male and female residents in performance evaluations on Accreditation Council for Graduate Medical Education (ACGME) milestones. Because of difficulties in blinding evaluators to gender, it remains unclear whether these observed disparities are because of implicit bias or other causes. OBJECTIVE: To estimate the magnitude of implicit gender bias in assessments of procedural competency in emergency medicine residents and whether the gender of the evaluator is associated with identified implicit gender bias. DESIGN, SETTING, AND PARTICIPANTS: A cross-sectional study was performed from 2018 to 2020 in which emergency medicine residency faculty assessed procedural competency by evaluating videos of residents performing 3 procedures in a simulated environment. They were blinded to the intent of the study. Proceduralists were filmed performing each procedure from 2 different viewpoints simultaneously by 2 different cameras. One was a gender-blinded (ie, hands-only) view, and the other a wide-angled gender-evident (ie, whole-body) view. The faculty evaluators viewed videos in a random order and assessed procedural competency on a global rating scale with extensive validity evidence for the evaluation of video-recorded procedural performance. MAIN OUTCOMES AND MEASURES: The primary outcome was to determine if there was a difference in the evaluation of procedural competency based on gender. The secondary outcome was to determine if there was a difference in the evaluations based on the gender of the evaluator. RESULTS: Fifty-one faculty evaluators enrolled from 19 states, with 22 male participants (43.1%), 29 female participants (56.9%), and a mean (SD) age of 37 (6.4) years. Each evaluator assessed all 60 procedures: 30 gender-blinded (hands-only view) videos and 30 identical gender-evident (wide angle) videos. There were no statistically significant differences in the study evaluators’ scores of the proceduralists based on their gender, and the gender of the evaluator was not associated with the difference in mean scores. CONCLUSIONS AND RELEVANCE: In this study, we did not identify a difference in the evaluation of procedural competency based upon the gender of the resident proceduralist or the gender of the faculty evaluator. American Medical Association 2022-02-07 /pmc/articles/PMC8822382/ /pubmed/35129594 http://dx.doi.org/10.1001/jamanetworkopen.2021.47351 Text en Copyright 2022 See A et al. JAMA Network Open. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the CC-BY License.
spellingShingle Original Investigation
See, Ashley
Pallaci, Michael
Aluisio, Adam R.
Beck-Esmay, Jenny
Menchine, Michael
Weinstock, Michael
Lam, Chun Nok
Riddell, Jeff
Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title_full Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title_fullStr Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title_full_unstemmed Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title_short Assessment of Implicit Gender Bias During Evaluation of Procedural Competency Among Emergency Medicine Residents
title_sort assessment of implicit gender bias during evaluation of procedural competency among emergency medicine residents
topic Original Investigation
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8822382/
https://www.ncbi.nlm.nih.gov/pubmed/35129594
http://dx.doi.org/10.1001/jamanetworkopen.2021.47351
work_keys_str_mv AT seeashley assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT pallacimichael assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT aluisioadamr assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT beckesmayjenny assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT menchinemichael assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT weinstockmichael assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT lamchunnok assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents
AT riddelljeff assessmentofimplicitgenderbiasduringevaluationofproceduralcompetencyamongemergencymedicineresidents