Cargando…

Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability

Background: The Medical Student Performance Evaluation (MSPE) is a primary source of information used by residency programs in their selection of trainees. The MSPE contains a narrative description of the applicant’s performance during medical school. In 2002, the Association of American Medical Col...

Descripción completa

Detalles Bibliográficos
Autores principales: Ward, Mark A., Palazzi, Debra L., Lorin, Martin I., Agrawal, Anoop, Frankenthal, Hilel, Turner, Teri L.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Taylor & Francis 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6225414/
https://www.ncbi.nlm.nih.gov/pubmed/30406730
http://dx.doi.org/10.1080/10872981.2018.1542922
_version_ 1783369770907729920
author Ward, Mark A.
Palazzi, Debra L.
Lorin, Martin I.
Agrawal, Anoop
Frankenthal, Hilel
Turner, Teri L.
author_facet Ward, Mark A.
Palazzi, Debra L.
Lorin, Martin I.
Agrawal, Anoop
Frankenthal, Hilel
Turner, Teri L.
author_sort Ward, Mark A.
collection PubMed
description Background: The Medical Student Performance Evaluation (MSPE) is a primary source of information used by residency programs in their selection of trainees. The MSPE contains a narrative description of the applicant’s performance during medical school. In 2002, the Association of American Medical Colleges’ guideline for preparation of the MSPE recommended inclusion of a comparative summative assessment of the student’s overall performance relative to his/her peers (final adjective). Objective: We hypothesize that the inclusion of a final adjective in the MSPE affects a reviewer’s assessment of the applicant’s desirability more than the narrative description of performance and designed a study to evaluate this hypothesis. Design: Fifty-six faculty members from the Departments of Pediatrics and Medicine with experience reviewing MSPEs as part of the intern selection process reviewed two pairs of mock MSPE letters. In each pair, the narrative in one letter was superior to that in the other. Two final adjectives describing relative class ranks were created. Each subject was first presented with a pair of letters with mismatched final adjective (study), i.e., the letter with the stronger narrative was presented with the weaker final adjective and vice versa. The subject was then presented with a second pair of letters without final adjectives (control). Subjects ranked the relative desirability of the two applicants in each pair. Results: The proportion of rankings congruent with the strength of the narratives under study and control conditions were compared. Subjects were significantly less likely to rank the applicants congruent with the strength of the narratives when the strength of the final adjectives conflicted with the strength of the narrative; 42.9% of study letters were ranked congruent with the narrative versus 82.1% of controls (p = 0.0001). Conclusion: The MSPE final adjective had a greater impact than the narrative description of performance on the determination of applicant desirability. Abbreviations: MSPE: Medical Student Performance Evaluation; AAMC: Association of American Medical Colleges; BCM: Baylor College of Medicine
format Online
Article
Text
id pubmed-6225414
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Taylor & Francis
record_format MEDLINE/PubMed
spelling pubmed-62254142018-11-13 Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability Ward, Mark A. Palazzi, Debra L. Lorin, Martin I. Agrawal, Anoop Frankenthal, Hilel Turner, Teri L. Med Educ Online Research Article Background: The Medical Student Performance Evaluation (MSPE) is a primary source of information used by residency programs in their selection of trainees. The MSPE contains a narrative description of the applicant’s performance during medical school. In 2002, the Association of American Medical Colleges’ guideline for preparation of the MSPE recommended inclusion of a comparative summative assessment of the student’s overall performance relative to his/her peers (final adjective). Objective: We hypothesize that the inclusion of a final adjective in the MSPE affects a reviewer’s assessment of the applicant’s desirability more than the narrative description of performance and designed a study to evaluate this hypothesis. Design: Fifty-six faculty members from the Departments of Pediatrics and Medicine with experience reviewing MSPEs as part of the intern selection process reviewed two pairs of mock MSPE letters. In each pair, the narrative in one letter was superior to that in the other. Two final adjectives describing relative class ranks were created. Each subject was first presented with a pair of letters with mismatched final adjective (study), i.e., the letter with the stronger narrative was presented with the weaker final adjective and vice versa. The subject was then presented with a second pair of letters without final adjectives (control). Subjects ranked the relative desirability of the two applicants in each pair. Results: The proportion of rankings congruent with the strength of the narratives under study and control conditions were compared. Subjects were significantly less likely to rank the applicants congruent with the strength of the narratives when the strength of the final adjectives conflicted with the strength of the narrative; 42.9% of study letters were ranked congruent with the narrative versus 82.1% of controls (p = 0.0001). Conclusion: The MSPE final adjective had a greater impact than the narrative description of performance on the determination of applicant desirability. Abbreviations: MSPE: Medical Student Performance Evaluation; AAMC: Association of American Medical Colleges; BCM: Baylor College of Medicine Taylor & Francis 2018-11-08 /pmc/articles/PMC6225414/ /pubmed/30406730 http://dx.doi.org/10.1080/10872981.2018.1542922 Text en © 2018 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group. http://creativecommons.org/licenses/by/4.0/ This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Ward, Mark A.
Palazzi, Debra L.
Lorin, Martin I.
Agrawal, Anoop
Frankenthal, Hilel
Turner, Teri L.
Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title_full Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title_fullStr Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title_full_unstemmed Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title_short Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability
title_sort impact of the final adjective in the medical student performance evaluation on determination of applicant desirability
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6225414/
https://www.ncbi.nlm.nih.gov/pubmed/30406730
http://dx.doi.org/10.1080/10872981.2018.1542922
work_keys_str_mv AT wardmarka impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability
AT palazzidebral impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability
AT lorinmartini impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability
AT agrawalanoop impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability
AT frankenthalhilel impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability
AT turnerteril impactofthefinaladjectiveinthemedicalstudentperformanceevaluationondeterminationofapplicantdesirability