Cargando…

Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training

Situational judgment tests (SJTs) are often used in aptitude testing and present practice-specific challenges. Their implementation into online training programs provides the opportunity to assess learning progress and improve training quality. In this study, text-based SJTs for oncology physicians...

Descripción completa

Detalles Bibliográficos
Autores principales: Rogge, Alizé A., Helmer, Stefanie M., Kiessling, Claudia, Witt, Claudia M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9550743/
https://www.ncbi.nlm.nih.gov/pubmed/33655466
http://dx.doi.org/10.1007/s13187-021-01973-9
_version_ 1784805949178904576
author Rogge, Alizé A.
Helmer, Stefanie M.
Kiessling, Claudia
Witt, Claudia M.
author_facet Rogge, Alizé A.
Helmer, Stefanie M.
Kiessling, Claudia
Witt, Claudia M.
author_sort Rogge, Alizé A.
collection PubMed
description Situational judgment tests (SJTs) are often used in aptitude testing and present practice-specific challenges. Their implementation into online training programs provides the opportunity to assess learning progress and improve training quality. In this study, text-based SJTs for oncology physicians were developed, validated, and implemented into the KOKON-KTO training which uses a blended learning training format to teach oncology physicians how to consult cancer patients on complementary and integrative medicine (CIM). The SJT was implemented to measure the e-learning results. In the development and validation phase, a total of 15 SJTs (each SJT including 1 best choice answer based on training content and 4 distractors; 9 SJTs for oncologists and 6 SJTs for oncology gynecologists only) were developed by an interprofessional team (n=5) using real-case vignettes and applying an in-depth review process. Best answers were validated by experts (oncologists and oncology gynecologists) with experience in advising cancer patients on CIM. In the implementation and evaluation phase, SJTs were answered by KOKON-KTO training participants (n=19) pre- and post e-learning. Results were analyzed using descriptive measurements, item difficulties, and Cohen’s d for effect size pre- and post-training. The experts (n=12, 49.8% gynecologists) agreed with best choice answers (69.4% for oncology gynecology; 81.5% for oncology) in 12 out of 15 SJTs. Comparing pre- and post-training scores, KOKON-KTO training participants were able to improve knowledge substantially (effect sizes for oncologists d=1.7; oncology gynecologists d= .71). Future studies need to increase the number of experts and SJTs in order to apply further psychometric measurements. As part of the KOKON-KTO study, this project is registered as DRKS00012704 on the “German Clinical Trials Register” (Date of registration: 28.08.2017).
format Online
Article
Text
id pubmed-9550743
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-95507432022-10-12 Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training Rogge, Alizé A. Helmer, Stefanie M. Kiessling, Claudia Witt, Claudia M. J Cancer Educ Article Situational judgment tests (SJTs) are often used in aptitude testing and present practice-specific challenges. Their implementation into online training programs provides the opportunity to assess learning progress and improve training quality. In this study, text-based SJTs for oncology physicians were developed, validated, and implemented into the KOKON-KTO training which uses a blended learning training format to teach oncology physicians how to consult cancer patients on complementary and integrative medicine (CIM). The SJT was implemented to measure the e-learning results. In the development and validation phase, a total of 15 SJTs (each SJT including 1 best choice answer based on training content and 4 distractors; 9 SJTs for oncologists and 6 SJTs for oncology gynecologists only) were developed by an interprofessional team (n=5) using real-case vignettes and applying an in-depth review process. Best answers were validated by experts (oncologists and oncology gynecologists) with experience in advising cancer patients on CIM. In the implementation and evaluation phase, SJTs were answered by KOKON-KTO training participants (n=19) pre- and post e-learning. Results were analyzed using descriptive measurements, item difficulties, and Cohen’s d for effect size pre- and post-training. The experts (n=12, 49.8% gynecologists) agreed with best choice answers (69.4% for oncology gynecology; 81.5% for oncology) in 12 out of 15 SJTs. Comparing pre- and post-training scores, KOKON-KTO training participants were able to improve knowledge substantially (effect sizes for oncologists d=1.7; oncology gynecologists d= .71). Future studies need to increase the number of experts and SJTs in order to apply further psychometric measurements. As part of the KOKON-KTO study, this project is registered as DRKS00012704 on the “German Clinical Trials Register” (Date of registration: 28.08.2017). Springer US 2021-03-02 2022 /pmc/articles/PMC9550743/ /pubmed/33655466 http://dx.doi.org/10.1007/s13187-021-01973-9 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Rogge, Alizé A.
Helmer, Stefanie M.
Kiessling, Claudia
Witt, Claudia M.
Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title_full Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title_fullStr Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title_full_unstemmed Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title_short Development and Implementation of Situational Judgment Tests as an Evaluation Method for Training Oncology Physicians: Application in the KOKON-KTO Training
title_sort development and implementation of situational judgment tests as an evaluation method for training oncology physicians: application in the kokon-kto training
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9550743/
https://www.ncbi.nlm.nih.gov/pubmed/33655466
http://dx.doi.org/10.1007/s13187-021-01973-9
work_keys_str_mv AT roggealizea developmentandimplementationofsituationaljudgmenttestsasanevaluationmethodfortrainingoncologyphysiciansapplicationinthekokonktotraining
AT helmerstefaniem developmentandimplementationofsituationaljudgmenttestsasanevaluationmethodfortrainingoncologyphysiciansapplicationinthekokonktotraining
AT kiesslingclaudia developmentandimplementationofsituationaljudgmenttestsasanevaluationmethodfortrainingoncologyphysiciansapplicationinthekokonktotraining
AT wittclaudiam developmentandimplementationofsituationaljudgmenttestsasanevaluationmethodfortrainingoncologyphysiciansapplicationinthekokonktotraining