Cargando…

The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools

BACKGROUND: Most UK medical schools use aptitude tests during student selection, but large-scale studies of predictive validity are rare. This study assesses the United Kingdom Clinical Aptitude Test (UKCAT), and its four sub-scales, along with measures of educational attainment, individual and cont...

Descripción completa

Detalles Bibliográficos
Autores principales: McManus, I C, Dewberry, Chris, Nicholson, Sandra, Dowell, Jonathan S
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3827332/
https://www.ncbi.nlm.nih.gov/pubmed/24229380
http://dx.doi.org/10.1186/1741-7015-11-244
_version_ 1782291061596487680
author McManus, I C
Dewberry, Chris
Nicholson, Sandra
Dowell, Jonathan S
author_facet McManus, I C
Dewberry, Chris
Nicholson, Sandra
Dowell, Jonathan S
author_sort McManus, I C
collection PubMed
description BACKGROUND: Most UK medical schools use aptitude tests during student selection, but large-scale studies of predictive validity are rare. This study assesses the United Kingdom Clinical Aptitude Test (UKCAT), and its four sub-scales, along with measures of educational attainment, individual and contextual socio-economic background factors, as predictors of performance in the first year of medical school training. METHODS: A prospective study of 4,811 students in 12 UK medical schools taking the UKCAT from 2006 to 2008 as a part of the medical school application, for whom first year medical school examination results were available in 2008 to 2010. RESULTS: UKCAT scores and educational attainment measures (General Certificate of Education (GCE): A-levels, and so on; or Scottish Qualifications Authority (SQA): Scottish Highers, and so on) were significant predictors of outcome. UKCAT predicted outcome better in female students than male students, and better in mature than non-mature students. Incremental validity of UKCAT taking educational attainment into account was significant, but small. Medical school performance was also affected by sex (male students performing less well), ethnicity (non-White students performing less well), and a contextual measure of secondary schooling, students from secondary schools with greater average attainment at A-level (irrespective of public or private sector) performing less well. Multilevel modeling showed no differences between medical schools in predictive ability of the various measures. UKCAT sub-scales predicted similarly, except that Verbal Reasoning correlated positively with performance on Theory examinations, but negatively with Skills assessments. CONCLUSIONS: This collaborative study in 12 medical schools shows the power of large-scale studies of medical education for answering previously unanswerable but important questions about medical student selection, education and training. UKCAT has predictive validity as a predictor of medical school outcome, particularly in mature applicants to medical school. UKCAT offers small but significant incremental validity which is operationally valuable where medical schools are making selection decisions based on incomplete measures of educational attainment. The study confirms the validity of using all the existing measures of educational attainment in full at the time of selection decision-making. Contextual measures provide little additional predictive value, except that students from high attaining secondary schools perform less well, an effect previously shown for UK universities in general.
format Online
Article
Text
id pubmed-3827332
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-38273322013-11-18 The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools McManus, I C Dewberry, Chris Nicholson, Sandra Dowell, Jonathan S BMC Med Research Article BACKGROUND: Most UK medical schools use aptitude tests during student selection, but large-scale studies of predictive validity are rare. This study assesses the United Kingdom Clinical Aptitude Test (UKCAT), and its four sub-scales, along with measures of educational attainment, individual and contextual socio-economic background factors, as predictors of performance in the first year of medical school training. METHODS: A prospective study of 4,811 students in 12 UK medical schools taking the UKCAT from 2006 to 2008 as a part of the medical school application, for whom first year medical school examination results were available in 2008 to 2010. RESULTS: UKCAT scores and educational attainment measures (General Certificate of Education (GCE): A-levels, and so on; or Scottish Qualifications Authority (SQA): Scottish Highers, and so on) were significant predictors of outcome. UKCAT predicted outcome better in female students than male students, and better in mature than non-mature students. Incremental validity of UKCAT taking educational attainment into account was significant, but small. Medical school performance was also affected by sex (male students performing less well), ethnicity (non-White students performing less well), and a contextual measure of secondary schooling, students from secondary schools with greater average attainment at A-level (irrespective of public or private sector) performing less well. Multilevel modeling showed no differences between medical schools in predictive ability of the various measures. UKCAT sub-scales predicted similarly, except that Verbal Reasoning correlated positively with performance on Theory examinations, but negatively with Skills assessments. CONCLUSIONS: This collaborative study in 12 medical schools shows the power of large-scale studies of medical education for answering previously unanswerable but important questions about medical student selection, education and training. UKCAT has predictive validity as a predictor of medical school outcome, particularly in mature applicants to medical school. UKCAT offers small but significant incremental validity which is operationally valuable where medical schools are making selection decisions based on incomplete measures of educational attainment. The study confirms the validity of using all the existing measures of educational attainment in full at the time of selection decision-making. Contextual measures provide little additional predictive value, except that students from high attaining secondary schools perform less well, an effect previously shown for UK universities in general. BioMed Central 2013-11-14 /pmc/articles/PMC3827332/ /pubmed/24229380 http://dx.doi.org/10.1186/1741-7015-11-244 Text en Copyright © 2013 McManus et al.; licensee BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
McManus, I C
Dewberry, Chris
Nicholson, Sandra
Dowell, Jonathan S
The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title_full The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title_fullStr The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title_full_unstemmed The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title_short The UKCAT-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 UK medical schools
title_sort ukcat-12 study: educational attainment, aptitude test performance, demographic and socio-economic contextual factors as predictors of first year outcome in a cross-sectional collaborative study of 12 uk medical schools
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3827332/
https://www.ncbi.nlm.nih.gov/pubmed/24229380
http://dx.doi.org/10.1186/1741-7015-11-244
work_keys_str_mv AT mcmanusic theukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT dewberrychris theukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT nicholsonsandra theukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT dowelljonathans theukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT mcmanusic ukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT dewberrychris ukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT nicholsonsandra ukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools
AT dowelljonathans ukcat12studyeducationalattainmentaptitudetestperformancedemographicandsocioeconomiccontextualfactorsaspredictorsoffirstyearoutcomeinacrosssectionalcollaborativestudyof12ukmedicalschools