Cargando…

How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods

Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance as...

Descripción completa

Detalles Bibliográficos
Autores principales: Kulgemeyer, Christoph, Riese, Josef, Vogelsang, Christoph, Buschhüter, David, Borowski, Andreas, Weißbach, Anna, Jordans, Melanie, Reinhold, Peter, Schecker, Horst
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Fachmedien Wiesbaden 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10244832/
https://www.ncbi.nlm.nih.gov/pubmed/37359180
http://dx.doi.org/10.1007/s11618-023-01154-y
_version_ 1785054732735217664
author Kulgemeyer, Christoph
Riese, Josef
Vogelsang, Christoph
Buschhüter, David
Borowski, Andreas
Weißbach, Anna
Jordans, Melanie
Reinhold, Peter
Schecker, Horst
author_facet Kulgemeyer, Christoph
Riese, Josef
Vogelsang, Christoph
Buschhüter, David
Borowski, Andreas
Weißbach, Anna
Jordans, Melanie
Reinhold, Peter
Schecker, Horst
author_sort Kulgemeyer, Christoph
collection PubMed
description Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.
format Online
Article
Text
id pubmed-10244832
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer Fachmedien Wiesbaden
record_format MEDLINE/PubMed
spelling pubmed-102448322023-06-08 How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods Kulgemeyer, Christoph Riese, Josef Vogelsang, Christoph Buschhüter, David Borowski, Andreas Weißbach, Anna Jordans, Melanie Reinhold, Peter Schecker, Horst Z Erziehwiss Schwerpunkt Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting. Springer Fachmedien Wiesbaden 2023-06-07 /pmc/articles/PMC10244832/ /pubmed/37359180 http://dx.doi.org/10.1007/s11618-023-01154-y Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Schwerpunkt
Kulgemeyer, Christoph
Riese, Josef
Vogelsang, Christoph
Buschhüter, David
Borowski, Andreas
Weißbach, Anna
Jordans, Melanie
Reinhold, Peter
Schecker, Horst
How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title_full How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title_fullStr How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title_full_unstemmed How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title_short How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
title_sort how authenticity impacts validity: developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
topic Schwerpunkt
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10244832/
https://www.ncbi.nlm.nih.gov/pubmed/37359180
http://dx.doi.org/10.1007/s11618-023-01154-y
work_keys_str_mv AT kulgemeyerchristoph howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT riesejosef howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT vogelsangchristoph howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT buschhuterdavid howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT borowskiandreas howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT weißbachanna howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT jordansmelanie howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT reinholdpeter howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods
AT scheckerhorst howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods