Cargando…

Changing the culture of assessment: the dominance of the summative assessment paradigm

BACKGROUND: Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourag...

Descripción completa

Detalles Bibliográficos
Autores principales: Harrison, Christopher J., Könings, Karen D., Schuwirth, Lambert W. T., Wass, Valerie, van der Vleuten, Cees P. M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5410042/
https://www.ncbi.nlm.nih.gov/pubmed/28454581
http://dx.doi.org/10.1186/s12909-017-0912-5
_version_ 1783232593079042048
author Harrison, Christopher J.
Könings, Karen D.
Schuwirth, Lambert W. T.
Wass, Valerie
van der Vleuten, Cees P. M.
author_facet Harrison, Christopher J.
Könings, Karen D.
Schuwirth, Lambert W. T.
Wass, Valerie
van der Vleuten, Cees P. M.
author_sort Harrison, Christopher J.
collection PubMed
description BACKGROUND: Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students’ use of assessment-related feedback. METHODS: Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. RESULTS: Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants’ prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. CONCLUSIONS: Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step.
format Online
Article
Text
id pubmed-5410042
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-54100422017-05-02 Changing the culture of assessment: the dominance of the summative assessment paradigm Harrison, Christopher J. Könings, Karen D. Schuwirth, Lambert W. T. Wass, Valerie van der Vleuten, Cees P. M. BMC Med Educ Research Article BACKGROUND: Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students’ use of assessment-related feedback. METHODS: Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. RESULTS: Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants’ prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. CONCLUSIONS: Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step. BioMed Central 2017-04-28 /pmc/articles/PMC5410042/ /pubmed/28454581 http://dx.doi.org/10.1186/s12909-017-0912-5 Text en © The Author(s). 2017 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Research Article
Harrison, Christopher J.
Könings, Karen D.
Schuwirth, Lambert W. T.
Wass, Valerie
van der Vleuten, Cees P. M.
Changing the culture of assessment: the dominance of the summative assessment paradigm
title Changing the culture of assessment: the dominance of the summative assessment paradigm
title_full Changing the culture of assessment: the dominance of the summative assessment paradigm
title_fullStr Changing the culture of assessment: the dominance of the summative assessment paradigm
title_full_unstemmed Changing the culture of assessment: the dominance of the summative assessment paradigm
title_short Changing the culture of assessment: the dominance of the summative assessment paradigm
title_sort changing the culture of assessment: the dominance of the summative assessment paradigm
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5410042/
https://www.ncbi.nlm.nih.gov/pubmed/28454581
http://dx.doi.org/10.1186/s12909-017-0912-5
work_keys_str_mv AT harrisonchristopherj changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT koningskarend changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT schuwirthlambertwt changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT wassvalerie changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT vandervleutenceespm changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm