Cargando…

Situational judgment test as an additional tool in a medical admission test: an observational investigation

BACKGROUND: In the framework of medical university admission procedures the assessment of non-cognitive abilities is increasingly demanded. As tool for assessing personal qualities or the ability to handle theoretical social constructs in complex situations, the Situational Judgment Test (SJT), amon...

Descripción completa

Detalles Bibliográficos
Autores principales: Luschin-Ebengreuth, Marion, Dimai, Hans P, Ithaler, Daniel, Neges, Heide M, Reibnegger, Gilbert
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2015
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4371884/
https://www.ncbi.nlm.nih.gov/pubmed/25889941
http://dx.doi.org/10.1186/s13104-015-1033-z
_version_ 1782363111521517568
author Luschin-Ebengreuth, Marion
Dimai, Hans P
Ithaler, Daniel
Neges, Heide M
Reibnegger, Gilbert
author_facet Luschin-Ebengreuth, Marion
Dimai, Hans P
Ithaler, Daniel
Neges, Heide M
Reibnegger, Gilbert
author_sort Luschin-Ebengreuth, Marion
collection PubMed
description BACKGROUND: In the framework of medical university admission procedures the assessment of non-cognitive abilities is increasingly demanded. As tool for assessing personal qualities or the ability to handle theoretical social constructs in complex situations, the Situational Judgment Test (SJT), among other measurement instruments, is discussed in the literature. This study focuses on the development and the results of the SJT as part of the admission test for the study of human medicine and dentistry at one medical university in Austria. METHODS: Observational investigation focusing on the results of the SJT. 4741 applicants were included in the study. To yield comparable results for the different test parts, “relative scores” for each test part were calculated. Performance differences between women and men in the various test parts are analyzed using effect sizes based on comparison of mean values (Cohen’s d). The associations between the relative scores achieved in the various test parts were assessed by computing pairwise linear correlation coefficients between all test parts and visualized by bivariate scatterplots. RESULTS: Among successful candidates, men consistently outperform women. Men perform better in physics and mathematics. Women perform better in the SJT part. The least discriminatory test part was the SJT. A strong correlation between biology and chemistry and moderate correlations between the other test parts except SJT is obvious. The relative scores are not symmetrically distributed. CONCLUSIONS: The cognitive loading of the performed SJTs points to the low correlation between the SJTs and cognitive abilities. Adding the SJT part into the admission test, in order to cover more than only knowledge and understanding of natural sciences among the applicants has been quite successful.
format Online
Article
Text
id pubmed-4371884
institution National Center for Biotechnology Information
language English
publishDate 2015
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-43718842015-03-25 Situational judgment test as an additional tool in a medical admission test: an observational investigation Luschin-Ebengreuth, Marion Dimai, Hans P Ithaler, Daniel Neges, Heide M Reibnegger, Gilbert BMC Res Notes Research Article BACKGROUND: In the framework of medical university admission procedures the assessment of non-cognitive abilities is increasingly demanded. As tool for assessing personal qualities or the ability to handle theoretical social constructs in complex situations, the Situational Judgment Test (SJT), among other measurement instruments, is discussed in the literature. This study focuses on the development and the results of the SJT as part of the admission test for the study of human medicine and dentistry at one medical university in Austria. METHODS: Observational investigation focusing on the results of the SJT. 4741 applicants were included in the study. To yield comparable results for the different test parts, “relative scores” for each test part were calculated. Performance differences between women and men in the various test parts are analyzed using effect sizes based on comparison of mean values (Cohen’s d). The associations between the relative scores achieved in the various test parts were assessed by computing pairwise linear correlation coefficients between all test parts and visualized by bivariate scatterplots. RESULTS: Among successful candidates, men consistently outperform women. Men perform better in physics and mathematics. Women perform better in the SJT part. The least discriminatory test part was the SJT. A strong correlation between biology and chemistry and moderate correlations between the other test parts except SJT is obvious. The relative scores are not symmetrically distributed. CONCLUSIONS: The cognitive loading of the performed SJTs points to the low correlation between the SJTs and cognitive abilities. Adding the SJT part into the admission test, in order to cover more than only knowledge and understanding of natural sciences among the applicants has been quite successful. BioMed Central 2015-03-14 /pmc/articles/PMC4371884/ /pubmed/25889941 http://dx.doi.org/10.1186/s13104-015-1033-z Text en © Luschin-Ebengreuth et al.; licensee BioMed Central. 2015 This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Research Article
Luschin-Ebengreuth, Marion
Dimai, Hans P
Ithaler, Daniel
Neges, Heide M
Reibnegger, Gilbert
Situational judgment test as an additional tool in a medical admission test: an observational investigation
title Situational judgment test as an additional tool in a medical admission test: an observational investigation
title_full Situational judgment test as an additional tool in a medical admission test: an observational investigation
title_fullStr Situational judgment test as an additional tool in a medical admission test: an observational investigation
title_full_unstemmed Situational judgment test as an additional tool in a medical admission test: an observational investigation
title_short Situational judgment test as an additional tool in a medical admission test: an observational investigation
title_sort situational judgment test as an additional tool in a medical admission test: an observational investigation
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4371884/
https://www.ncbi.nlm.nih.gov/pubmed/25889941
http://dx.doi.org/10.1186/s13104-015-1033-z
work_keys_str_mv AT luschinebengreuthmarion situationaljudgmenttestasanadditionaltoolinamedicaladmissiontestanobservationalinvestigation
AT dimaihansp situationaljudgmenttestasanadditionaltoolinamedicaladmissiontestanobservationalinvestigation
AT ithalerdaniel situationaljudgmenttestasanadditionaltoolinamedicaladmissiontestanobservationalinvestigation
AT negesheidem situationaljudgmenttestasanadditionaltoolinamedicaladmissiontestanobservationalinvestigation
AT reibneggergilbert situationaljudgmenttestasanadditionaltoolinamedicaladmissiontestanobservationalinvestigation