Cargando…
Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study
BACKGROUND: Obesity is a major public health problem, yet residents undergo little formal training and assessment in obesity-related care. Given the recent growth of telehealth, physicians must further learn to apply these skills using a virtual platform. Therefore, we aimed to develop an objective...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9389479/ https://www.ncbi.nlm.nih.gov/pubmed/35986272 http://dx.doi.org/10.1186/s12909-022-03672-5 |
_version_ | 1784770455803002880 |
---|---|
author | Cameron, Natalie A. Kushner, Robert F. |
author_facet | Cameron, Natalie A. Kushner, Robert F. |
author_sort | Cameron, Natalie A. |
collection | PubMed |
description | BACKGROUND: Obesity is a major public health problem, yet residents undergo little formal training and assessment in obesity-related care. Given the recent growth of telehealth, physicians must further learn to apply these skills using a virtual platform. Therefore, we aimed to develop an objective structured clinical examination (OSCE) with reliable checklists to assess resident ability to take a patient-centered obesity-focused history that was feasible over telehealth based on published obesity competencies for medical education. METHODS: We developed a 15-minute telehealth OSCE to simulate an obesity-related encounter for residents modified from a script used to assess medical student obesity competencies. We designed three checklists to assess resident skills in history taking, communication and professionalism during the obesity-related encounter. Resident performance was assessed as the percentage of obesity-related history taking questions asked during the encounter and as the mean communication and professionalism scores on a scale of 1 through 5 with 1 representing unacceptable/offensive behavior and 5 representing excellent skills. Encounters and assessments were completed by two commissioned actors (standardized patients) and 26 internal medicine residents over a secure online platform. We assessed the reliability of each checklist by calculating the percent agreement between standardized patients and the kappa (κ) statistic on each checklist overall and by each checklist item. RESULTS: Overall agreement between standardized patients on the history taking, communication and professionalism checklists were 83.2% (κ = 0.63), 99.5% (κ = 0.72) and 97.8% (κ =0.44), respectively. On average, residents asked 64.8% of questions on the history taking checklist and scored 3.8 and 3.9 out of 5 on the communication and professionalism checklists, respectively. CONCLUSIONS: Results from this pilot study suggest that our telehealth obesity OSCE and checklists are moderately reliable for assessing key obesity competencies among residents on a virtual platform. Integrating obesity OSCEs and other educational interventions into residency curricula are needed to improve resident ability to take an obesity-focused history. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-022-03672-5. |
format | Online Article Text |
id | pubmed-9389479 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-93894792022-08-19 Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study Cameron, Natalie A. Kushner, Robert F. BMC Med Educ Research Article BACKGROUND: Obesity is a major public health problem, yet residents undergo little formal training and assessment in obesity-related care. Given the recent growth of telehealth, physicians must further learn to apply these skills using a virtual platform. Therefore, we aimed to develop an objective structured clinical examination (OSCE) with reliable checklists to assess resident ability to take a patient-centered obesity-focused history that was feasible over telehealth based on published obesity competencies for medical education. METHODS: We developed a 15-minute telehealth OSCE to simulate an obesity-related encounter for residents modified from a script used to assess medical student obesity competencies. We designed three checklists to assess resident skills in history taking, communication and professionalism during the obesity-related encounter. Resident performance was assessed as the percentage of obesity-related history taking questions asked during the encounter and as the mean communication and professionalism scores on a scale of 1 through 5 with 1 representing unacceptable/offensive behavior and 5 representing excellent skills. Encounters and assessments were completed by two commissioned actors (standardized patients) and 26 internal medicine residents over a secure online platform. We assessed the reliability of each checklist by calculating the percent agreement between standardized patients and the kappa (κ) statistic on each checklist overall and by each checklist item. RESULTS: Overall agreement between standardized patients on the history taking, communication and professionalism checklists were 83.2% (κ = 0.63), 99.5% (κ = 0.72) and 97.8% (κ =0.44), respectively. On average, residents asked 64.8% of questions on the history taking checklist and scored 3.8 and 3.9 out of 5 on the communication and professionalism checklists, respectively. CONCLUSIONS: Results from this pilot study suggest that our telehealth obesity OSCE and checklists are moderately reliable for assessing key obesity competencies among residents on a virtual platform. Integrating obesity OSCEs and other educational interventions into residency curricula are needed to improve resident ability to take an obesity-focused history. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-022-03672-5. BioMed Central 2022-08-19 /pmc/articles/PMC9389479/ /pubmed/35986272 http://dx.doi.org/10.1186/s12909-022-03672-5 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Article Cameron, Natalie A. Kushner, Robert F. Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title | Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title_full | Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title_fullStr | Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title_full_unstemmed | Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title_short | Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study |
title_sort | development of a telehealth obesity osce and reliable checklist for assessment of resident physicians: a pilot study |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9389479/ https://www.ncbi.nlm.nih.gov/pubmed/35986272 http://dx.doi.org/10.1186/s12909-022-03672-5 |
work_keys_str_mv | AT cameronnataliea developmentofatelehealthobesityosceandreliablechecklistforassessmentofresidentphysiciansapilotstudy AT kushnerrobertf developmentofatelehealthobesityosceandreliablechecklistforassessmentofresidentphysiciansapilotstudy |