Cargando…

Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias

BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop...

Descripción completa

Detalles Bibliográficos
Autores principales: Clay, Alison S., Andolsek, Kathryn M., Niederhoffer, Kira, Kandakatla, Apoorva, Zhang, Gloria, Price, Meghan, Alagesan, Priya, Jeffs, Sydney, DeLaura, Isabel, Nicholson, C. Phifer, Chudgar, Saumil M., Narayan, Aditee P., Knudsen, Nancy W., Blazar, Melinda, Edwards, Pamela, Buckley, Edward G.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10103041/
https://www.ncbi.nlm.nih.gov/pubmed/37060081
http://dx.doi.org/10.1186/s12909-023-04237-w
_version_ 1785025806016184320
author Clay, Alison S.
Andolsek, Kathryn M.
Niederhoffer, Kira
Kandakatla, Apoorva
Zhang, Gloria
Price, Meghan
Alagesan, Priya
Jeffs, Sydney
DeLaura, Isabel
Nicholson, C. Phifer
Chudgar, Saumil M.
Narayan, Aditee P.
Knudsen, Nancy W.
Blazar, Melinda
Edwards, Pamela
Buckley, Edward G.
author_facet Clay, Alison S.
Andolsek, Kathryn M.
Niederhoffer, Kira
Kandakatla, Apoorva
Zhang, Gloria
Price, Meghan
Alagesan, Priya
Jeffs, Sydney
DeLaura, Isabel
Nicholson, C. Phifer
Chudgar, Saumil M.
Narayan, Aditee P.
Knudsen, Nancy W.
Blazar, Melinda
Edwards, Pamela
Buckley, Edward G.
author_sort Clay, Alison S.
collection PubMed
description BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop asynchronous faculty development to rapidly educate/re-educate > 2000 clinical faculty spread across geographic sites and clinical disciplines on components of a well-written narrative and methods to minimize bias in the assessment of students. METHODS: We describe creation, implementation, and pilot data outcomes for an asynchronous faculty development curriculum created by a committee of volunteer learners and faculty. After reviewing the literature on the presence and impact of bias in clinical rotations and ways to mitigate bias in written narrative assessments, the committee developed a web-based curriculum using multimedia learning theory and principles of adult learning. Just-in-time supplemental materials accompanied the curriculum. The Dean added completion of the module by 90% of clinical faculty to the department chairperson’s annual education metric. Module completion was tracked in a learning management system, including time spent in the module and the answer to a single text entry question about intended changes in behavior. Thematic analysis of the text entry question with grounded theory and inductive processing was used to define themes of how faculty anticipate future teaching and assessment as a result of this curricula. OUTCOMES: Between January 1, 2021, and December 1, 2021, 2166 individuals completed the online module; 1820 spent between 5 and 90 min on the module, with a median time of 17 min and an average time of 20.2 min. 15/16 clinical departments achieved completion by 90% or more faculty. Major themes included: changing the wording of future narratives, changing content in future narratives, and focusing on efforts to change how faculty teach and lead teams, including efforts to minimize bias. CONCLUSIONS: We developed a faculty development curriculum on mitigating bias in written narratives with high rates of faculty participation. Inclusion of this module as part of the chair’s education performance metric likely impacted participation. Nevertheless, time spent in the module suggests that faculty engaged with the material. Other institutions could easily adapt this curriculum with provided materials. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-023-04237-w.
format Online
Article
Text
id pubmed-10103041
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-101030412023-04-15 Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias Clay, Alison S. Andolsek, Kathryn M. Niederhoffer, Kira Kandakatla, Apoorva Zhang, Gloria Price, Meghan Alagesan, Priya Jeffs, Sydney DeLaura, Isabel Nicholson, C. Phifer Chudgar, Saumil M. Narayan, Aditee P. Knudsen, Nancy W. Blazar, Melinda Edwards, Pamela Buckley, Edward G. BMC Med Educ Research BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop asynchronous faculty development to rapidly educate/re-educate > 2000 clinical faculty spread across geographic sites and clinical disciplines on components of a well-written narrative and methods to minimize bias in the assessment of students. METHODS: We describe creation, implementation, and pilot data outcomes for an asynchronous faculty development curriculum created by a committee of volunteer learners and faculty. After reviewing the literature on the presence and impact of bias in clinical rotations and ways to mitigate bias in written narrative assessments, the committee developed a web-based curriculum using multimedia learning theory and principles of adult learning. Just-in-time supplemental materials accompanied the curriculum. The Dean added completion of the module by 90% of clinical faculty to the department chairperson’s annual education metric. Module completion was tracked in a learning management system, including time spent in the module and the answer to a single text entry question about intended changes in behavior. Thematic analysis of the text entry question with grounded theory and inductive processing was used to define themes of how faculty anticipate future teaching and assessment as a result of this curricula. OUTCOMES: Between January 1, 2021, and December 1, 2021, 2166 individuals completed the online module; 1820 spent between 5 and 90 min on the module, with a median time of 17 min and an average time of 20.2 min. 15/16 clinical departments achieved completion by 90% or more faculty. Major themes included: changing the wording of future narratives, changing content in future narratives, and focusing on efforts to change how faculty teach and lead teams, including efforts to minimize bias. CONCLUSIONS: We developed a faculty development curriculum on mitigating bias in written narratives with high rates of faculty participation. Inclusion of this module as part of the chair’s education performance metric likely impacted participation. Nevertheless, time spent in the module suggests that faculty engaged with the material. Other institutions could easily adapt this curriculum with provided materials. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-023-04237-w. BioMed Central 2023-04-14 /pmc/articles/PMC10103041/ /pubmed/37060081 http://dx.doi.org/10.1186/s12909-023-04237-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Clay, Alison S.
Andolsek, Kathryn M.
Niederhoffer, Kira
Kandakatla, Apoorva
Zhang, Gloria
Price, Meghan
Alagesan, Priya
Jeffs, Sydney
DeLaura, Isabel
Nicholson, C. Phifer
Chudgar, Saumil M.
Narayan, Aditee P.
Knudsen, Nancy W.
Blazar, Melinda
Edwards, Pamela
Buckley, Edward G.
Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title_full Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title_fullStr Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title_full_unstemmed Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title_short Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
title_sort creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10103041/
https://www.ncbi.nlm.nih.gov/pubmed/37060081
http://dx.doi.org/10.1186/s12909-023-04237-w
work_keys_str_mv AT clayalisons creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT andolsekkathrynm creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT niederhofferkira creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT kandakatlaapoorva creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT zhanggloria creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT pricemeghan creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT alagesanpriya creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT jeffssydney creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT delauraisabel creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT nicholsoncphifer creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT chudgarsaumilm creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT narayanaditeep creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT knudsennancyw creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT blazarmelinda creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT edwardspamela creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias
AT buckleyedwardg creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias