Cargando…
Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis
INTRODUCTION: Musculoskeletal concerns are common, yet residents at our institution lacked arthrocentesis training. We created a workshop to teach residents knee and shoulder arthrocentesis, developed simulated assessment scenarios (SASs) with tools to measure procedural proficiency, and collected v...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Association of American Medical Colleges
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101652/ https://www.ncbi.nlm.nih.gov/pubmed/37064429 http://dx.doi.org/10.15766/mep_2374-8265.11309 |
_version_ | 1785025554748014592 |
---|---|
author | Murray, Jacob Ramirez-Gomez, Andrea Cahill, Mike Deptola, Amber Diffie, Colin McDonnell, Peter Metzler, John P. Olafsen, Nathan P. Zickuhr, Lisa |
author_facet | Murray, Jacob Ramirez-Gomez, Andrea Cahill, Mike Deptola, Amber Diffie, Colin McDonnell, Peter Metzler, John P. Olafsen, Nathan P. Zickuhr, Lisa |
author_sort | Murray, Jacob |
collection | PubMed |
description | INTRODUCTION: Musculoskeletal concerns are common, yet residents at our institution lacked arthrocentesis training. We created a workshop to teach residents knee and shoulder arthrocentesis, developed simulated assessment scenarios (SASs) with tools to measure procedural proficiency, and collected validity evidence. METHODS: A multidisciplinary group conducted a modified Delphi to define content for the workshop, SASs, and assessment tools. We defined minimum thresholds for competence in knee and shoulder arthrocentesis using the modified borderline-group method. We implemented the workshop and SASs in 2020 and 2021 and analyzed assessment tool scoring for statistical reliability and validity. Our program evaluation included SAS performance, participants’ survey responses, and change in the number of arthrocenteses performed in the internal medicine (IM) resident primary care clinic. RESULTS: Sixty-one residents (53 IM, eight physical medicine and rehabilitation [PM&R]) participated. Fifty-two (85%; 46 IM, six PM&R) completed the evaluation survey. We procured data from 48 knee and 65 shoulder SASs for validity evidence. All arthrocentesis SAS performances met the proficiency standard except one resident's shoulder SAS. Validity evidence revealed strong interrater reliability (α = .82 and .77 for knee and shoulder, respectively) and strong relational validity (p < .001 for both procedures). All participants rated workshop quality and usefulness as good or very good. The number of arthrocenteses performed at our institution's primary care clinic increased. DISCUSSION: We created a workshop to teach residents arthrocentesis and assessment tools with strong validity and reliability evidence. The workshop was well regarded by residents, who applied their arthrocentesis skills during patient care. |
format | Online Article Text |
id | pubmed-10101652 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Association of American Medical Colleges |
record_format | MEDLINE/PubMed |
spelling | pubmed-101016522023-04-14 Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis Murray, Jacob Ramirez-Gomez, Andrea Cahill, Mike Deptola, Amber Diffie, Colin McDonnell, Peter Metzler, John P. Olafsen, Nathan P. Zickuhr, Lisa MedEdPORTAL Original Publication INTRODUCTION: Musculoskeletal concerns are common, yet residents at our institution lacked arthrocentesis training. We created a workshop to teach residents knee and shoulder arthrocentesis, developed simulated assessment scenarios (SASs) with tools to measure procedural proficiency, and collected validity evidence. METHODS: A multidisciplinary group conducted a modified Delphi to define content for the workshop, SASs, and assessment tools. We defined minimum thresholds for competence in knee and shoulder arthrocentesis using the modified borderline-group method. We implemented the workshop and SASs in 2020 and 2021 and analyzed assessment tool scoring for statistical reliability and validity. Our program evaluation included SAS performance, participants’ survey responses, and change in the number of arthrocenteses performed in the internal medicine (IM) resident primary care clinic. RESULTS: Sixty-one residents (53 IM, eight physical medicine and rehabilitation [PM&R]) participated. Fifty-two (85%; 46 IM, six PM&R) completed the evaluation survey. We procured data from 48 knee and 65 shoulder SASs for validity evidence. All arthrocentesis SAS performances met the proficiency standard except one resident's shoulder SAS. Validity evidence revealed strong interrater reliability (α = .82 and .77 for knee and shoulder, respectively) and strong relational validity (p < .001 for both procedures). All participants rated workshop quality and usefulness as good or very good. The number of arthrocenteses performed at our institution's primary care clinic increased. DISCUSSION: We created a workshop to teach residents arthrocentesis and assessment tools with strong validity and reliability evidence. The workshop was well regarded by residents, who applied their arthrocentesis skills during patient care. Association of American Medical Colleges 2023-04-13 /pmc/articles/PMC10101652/ /pubmed/37064429 http://dx.doi.org/10.15766/mep_2374-8265.11309 Text en © 2023 Murray et al. https://creativecommons.org/licenses/by/4.0/This is an open-access publication distributed under the terms of the Creative Commons Attribution (https://creativecommons.org/licenses/by/4.0/) license. |
spellingShingle | Original Publication Murray, Jacob Ramirez-Gomez, Andrea Cahill, Mike Deptola, Amber Diffie, Colin McDonnell, Peter Metzler, John P. Olafsen, Nathan P. Zickuhr, Lisa Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title | Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title_full | Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title_fullStr | Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title_full_unstemmed | Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title_short | Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis |
title_sort | workshop, assessment, and validity evidence for tools measuring performance of knee and shoulder arthrocentesis |
topic | Original Publication |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10101652/ https://www.ncbi.nlm.nih.gov/pubmed/37064429 http://dx.doi.org/10.15766/mep_2374-8265.11309 |
work_keys_str_mv | AT murrayjacob workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT ramirezgomezandrea workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT cahillmike workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT deptolaamber workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT diffiecolin workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT mcdonnellpeter workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT metzlerjohnp workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT olafsennathanp workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis AT zickuhrlisa workshopassessmentandvalidityevidencefortoolsmeasuringperformanceofkneeandshoulderarthrocentesis |