Cargando…
How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods
Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance as...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Fachmedien Wiesbaden
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10244832/ https://www.ncbi.nlm.nih.gov/pubmed/37359180 http://dx.doi.org/10.1007/s11618-023-01154-y |
_version_ | 1785054732735217664 |
---|---|
author | Kulgemeyer, Christoph Riese, Josef Vogelsang, Christoph Buschhüter, David Borowski, Andreas Weißbach, Anna Jordans, Melanie Reinhold, Peter Schecker, Horst |
author_facet | Kulgemeyer, Christoph Riese, Josef Vogelsang, Christoph Buschhüter, David Borowski, Andreas Weißbach, Anna Jordans, Melanie Reinhold, Peter Schecker, Horst |
author_sort | Kulgemeyer, Christoph |
collection | PubMed |
description | Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting. |
format | Online Article Text |
id | pubmed-10244832 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer Fachmedien Wiesbaden |
record_format | MEDLINE/PubMed |
spelling | pubmed-102448322023-06-08 How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods Kulgemeyer, Christoph Riese, Josef Vogelsang, Christoph Buschhüter, David Borowski, Andreas Weißbach, Anna Jordans, Melanie Reinhold, Peter Schecker, Horst Z Erziehwiss Schwerpunkt Based on a literature review of studies on teachers’ professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller’s (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting. Springer Fachmedien Wiesbaden 2023-06-07 /pmc/articles/PMC10244832/ /pubmed/37359180 http://dx.doi.org/10.1007/s11618-023-01154-y Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Schwerpunkt Kulgemeyer, Christoph Riese, Josef Vogelsang, Christoph Buschhüter, David Borowski, Andreas Weißbach, Anna Jordans, Melanie Reinhold, Peter Schecker, Horst How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title | How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title_full | How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title_fullStr | How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title_full_unstemmed | How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title_short | How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
title_sort | how authenticity impacts validity: developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods |
topic | Schwerpunkt |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10244832/ https://www.ncbi.nlm.nih.gov/pubmed/37359180 http://dx.doi.org/10.1007/s11618-023-01154-y |
work_keys_str_mv | AT kulgemeyerchristoph howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT riesejosef howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT vogelsangchristoph howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT buschhuterdavid howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT borowskiandreas howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT weißbachanna howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT jordansmelanie howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT reinholdpeter howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods AT scheckerhorst howauthenticityimpactsvaliditydevelopingamodelofteachereducationassessmentandexploringtheeffectsofthedigitisationofassessmentmethods |