Cargando…
Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias
BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop...
Autores principales: | , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10103041/ https://www.ncbi.nlm.nih.gov/pubmed/37060081 http://dx.doi.org/10.1186/s12909-023-04237-w |
_version_ | 1785025806016184320 |
---|---|
author | Clay, Alison S. Andolsek, Kathryn M. Niederhoffer, Kira Kandakatla, Apoorva Zhang, Gloria Price, Meghan Alagesan, Priya Jeffs, Sydney DeLaura, Isabel Nicholson, C. Phifer Chudgar, Saumil M. Narayan, Aditee P. Knudsen, Nancy W. Blazar, Melinda Edwards, Pamela Buckley, Edward G. |
author_facet | Clay, Alison S. Andolsek, Kathryn M. Niederhoffer, Kira Kandakatla, Apoorva Zhang, Gloria Price, Meghan Alagesan, Priya Jeffs, Sydney DeLaura, Isabel Nicholson, C. Phifer Chudgar, Saumil M. Narayan, Aditee P. Knudsen, Nancy W. Blazar, Melinda Edwards, Pamela Buckley, Edward G. |
author_sort | Clay, Alison S. |
collection | PubMed |
description | BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop asynchronous faculty development to rapidly educate/re-educate > 2000 clinical faculty spread across geographic sites and clinical disciplines on components of a well-written narrative and methods to minimize bias in the assessment of students. METHODS: We describe creation, implementation, and pilot data outcomes for an asynchronous faculty development curriculum created by a committee of volunteer learners and faculty. After reviewing the literature on the presence and impact of bias in clinical rotations and ways to mitigate bias in written narrative assessments, the committee developed a web-based curriculum using multimedia learning theory and principles of adult learning. Just-in-time supplemental materials accompanied the curriculum. The Dean added completion of the module by 90% of clinical faculty to the department chairperson’s annual education metric. Module completion was tracked in a learning management system, including time spent in the module and the answer to a single text entry question about intended changes in behavior. Thematic analysis of the text entry question with grounded theory and inductive processing was used to define themes of how faculty anticipate future teaching and assessment as a result of this curricula. OUTCOMES: Between January 1, 2021, and December 1, 2021, 2166 individuals completed the online module; 1820 spent between 5 and 90 min on the module, with a median time of 17 min and an average time of 20.2 min. 15/16 clinical departments achieved completion by 90% or more faculty. Major themes included: changing the wording of future narratives, changing content in future narratives, and focusing on efforts to change how faculty teach and lead teams, including efforts to minimize bias. CONCLUSIONS: We developed a faculty development curriculum on mitigating bias in written narratives with high rates of faculty participation. Inclusion of this module as part of the chair’s education performance metric likely impacted participation. Nevertheless, time spent in the module suggests that faculty engaged with the material. Other institutions could easily adapt this curriculum with provided materials. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-023-04237-w. |
format | Online Article Text |
id | pubmed-10103041 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-101030412023-04-15 Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias Clay, Alison S. Andolsek, Kathryn M. Niederhoffer, Kira Kandakatla, Apoorva Zhang, Gloria Price, Meghan Alagesan, Priya Jeffs, Sydney DeLaura, Isabel Nicholson, C. Phifer Chudgar, Saumil M. Narayan, Aditee P. Knudsen, Nancy W. Blazar, Melinda Edwards, Pamela Buckley, Edward G. BMC Med Educ Research BACKGROUND: The COVID-19 pandemic in parallel with concerns about bias in grading resulted in many medical schools adopting pass/fail clinical grading and relying solely on narrative assessments. However, narratives often contain bias and lack specificity. The purpose of this project was to develop asynchronous faculty development to rapidly educate/re-educate > 2000 clinical faculty spread across geographic sites and clinical disciplines on components of a well-written narrative and methods to minimize bias in the assessment of students. METHODS: We describe creation, implementation, and pilot data outcomes for an asynchronous faculty development curriculum created by a committee of volunteer learners and faculty. After reviewing the literature on the presence and impact of bias in clinical rotations and ways to mitigate bias in written narrative assessments, the committee developed a web-based curriculum using multimedia learning theory and principles of adult learning. Just-in-time supplemental materials accompanied the curriculum. The Dean added completion of the module by 90% of clinical faculty to the department chairperson’s annual education metric. Module completion was tracked in a learning management system, including time spent in the module and the answer to a single text entry question about intended changes in behavior. Thematic analysis of the text entry question with grounded theory and inductive processing was used to define themes of how faculty anticipate future teaching and assessment as a result of this curricula. OUTCOMES: Between January 1, 2021, and December 1, 2021, 2166 individuals completed the online module; 1820 spent between 5 and 90 min on the module, with a median time of 17 min and an average time of 20.2 min. 15/16 clinical departments achieved completion by 90% or more faculty. Major themes included: changing the wording of future narratives, changing content in future narratives, and focusing on efforts to change how faculty teach and lead teams, including efforts to minimize bias. CONCLUSIONS: We developed a faculty development curriculum on mitigating bias in written narratives with high rates of faculty participation. Inclusion of this module as part of the chair’s education performance metric likely impacted participation. Nevertheless, time spent in the module suggests that faculty engaged with the material. Other institutions could easily adapt this curriculum with provided materials. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-023-04237-w. BioMed Central 2023-04-14 /pmc/articles/PMC10103041/ /pubmed/37060081 http://dx.doi.org/10.1186/s12909-023-04237-w Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Clay, Alison S. Andolsek, Kathryn M. Niederhoffer, Kira Kandakatla, Apoorva Zhang, Gloria Price, Meghan Alagesan, Priya Jeffs, Sydney DeLaura, Isabel Nicholson, C. Phifer Chudgar, Saumil M. Narayan, Aditee P. Knudsen, Nancy W. Blazar, Melinda Edwards, Pamela Buckley, Edward G. Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title | Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title_full | Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title_fullStr | Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title_full_unstemmed | Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title_short | Creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
title_sort | creation of an asynchronous faculty development curriculum on well-written narrative assessments that avoid bias |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10103041/ https://www.ncbi.nlm.nih.gov/pubmed/37060081 http://dx.doi.org/10.1186/s12909-023-04237-w |
work_keys_str_mv | AT clayalisons creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT andolsekkathrynm creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT niederhofferkira creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT kandakatlaapoorva creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT zhanggloria creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT pricemeghan creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT alagesanpriya creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT jeffssydney creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT delauraisabel creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT nicholsoncphifer creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT chudgarsaumilm creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT narayanaditeep creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT knudsennancyw creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT blazarmelinda creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT edwardspamela creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias AT buckleyedwardg creationofanasynchronousfacultydevelopmentcurriculumonwellwrittennarrativeassessmentsthatavoidbias |