Cargando…
Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study
BACKGROUND: The VSTEP Examination Suite is a collection of evidence-based standardized assessments for persons after stroke. It was developed by an interdisciplinary team in collaboration with clinician users. It consists of 5 standardized assessments: 2 performance-based tests using the Kinect came...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10450535/ https://www.ncbi.nlm.nih.gov/pubmed/37561552 http://dx.doi.org/10.2196/44361 |
_version_ | 1785095220601290752 |
---|---|
author | Deutsch, Judith E Palmieri, John L Gorin, Holly Wendell, Augustus Wohn, Donghee Yvette Damodaran, Harish |
author_facet | Deutsch, Judith E Palmieri, John L Gorin, Holly Wendell, Augustus Wohn, Donghee Yvette Damodaran, Harish |
author_sort | Deutsch, Judith E |
collection | PubMed |
description | BACKGROUND: The VSTEP Examination Suite is a collection of evidence-based standardized assessments for persons after stroke. It was developed by an interdisciplinary team in collaboration with clinician users. It consists of 5 standardized assessments: 2 performance-based tests using the Kinect camera (Microsoft Corp) to collect kinematics (5-Time Sit-to-Stand and 4-Square Test); 2 additional performance-based tests (10-Meter Walk Test and 6-Minute Walk Test); and 1 patient-reported outcome measure, the Activities-Specific Balance Confidence Scale. OBJECTIVE: This study aimed to describe the development of the VSTEP Examination Suite and its evaluation as an educational tool by physical therapy students and faculty to determine its usefulness and usability. METHODS: A total of 6 students from a Doctor of Physical Therapy program in the United States and 6 faculty members who teach standardized assessments in different physical therapy programs from the United States and Israel were recruited by convenience sampling to participate in the study. They interacted with the system using a talk-aloud procedure either in pairs or individually. The transcripts of the sessions were coded deductively (by 3 investigators) with a priori categories of usability and usefulness, and comments were labeled as negative or positive. The frequencies of the deductive themes of usefulness and usability were tested for differences between faculty and students using a Wilcoxon rank sum test. A second round of inductive coding was performed by 3 investigators guided by theories of technology adoption, clinical reasoning, and education. RESULTS: The faculty members’ and students’ positive useful comments ranged from 83% (10/12) to 100%. There were no significant differences in usefulness comments between students and faculty. Regarding usability, faculty and students had the lowest frequency of positive comments for the 10-Meter Walk Test (5/10, 50%). Students also reported a high frequency of negative comments on the 4-Square Test (9/21, 43%). Students had a statistically significantly higher number of negative usability comments compared with faculty (W=5.7; P=.02), specifically for the 5-Time Sit-to-Stand (W=5.3; P=.02). Themes emerged related to variable knowledge about the standardized tests, value as a teaching and learning tool, technology being consistent with clinical reasoning in addition to ensuring reliability, expert-to-novice clinical reasoning (students), and usability. CONCLUSIONS: The VSTEP Examination Suite was found to be useful by both faculty and students. Reasons for perceived usefulness had some overlap, but there were also differences based on role and experience. Usability testing revealed opportunities for technology refinement. The development of the technology by interdisciplinary teams and testing with multiple types of users may increase adoption. |
format | Online Article Text |
id | pubmed-10450535 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-104505352023-08-26 Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study Deutsch, Judith E Palmieri, John L Gorin, Holly Wendell, Augustus Wohn, Donghee Yvette Damodaran, Harish JMIR Med Educ Original Paper BACKGROUND: The VSTEP Examination Suite is a collection of evidence-based standardized assessments for persons after stroke. It was developed by an interdisciplinary team in collaboration with clinician users. It consists of 5 standardized assessments: 2 performance-based tests using the Kinect camera (Microsoft Corp) to collect kinematics (5-Time Sit-to-Stand and 4-Square Test); 2 additional performance-based tests (10-Meter Walk Test and 6-Minute Walk Test); and 1 patient-reported outcome measure, the Activities-Specific Balance Confidence Scale. OBJECTIVE: This study aimed to describe the development of the VSTEP Examination Suite and its evaluation as an educational tool by physical therapy students and faculty to determine its usefulness and usability. METHODS: A total of 6 students from a Doctor of Physical Therapy program in the United States and 6 faculty members who teach standardized assessments in different physical therapy programs from the United States and Israel were recruited by convenience sampling to participate in the study. They interacted with the system using a talk-aloud procedure either in pairs or individually. The transcripts of the sessions were coded deductively (by 3 investigators) with a priori categories of usability and usefulness, and comments were labeled as negative or positive. The frequencies of the deductive themes of usefulness and usability were tested for differences between faculty and students using a Wilcoxon rank sum test. A second round of inductive coding was performed by 3 investigators guided by theories of technology adoption, clinical reasoning, and education. RESULTS: The faculty members’ and students’ positive useful comments ranged from 83% (10/12) to 100%. There were no significant differences in usefulness comments between students and faculty. Regarding usability, faculty and students had the lowest frequency of positive comments for the 10-Meter Walk Test (5/10, 50%). Students also reported a high frequency of negative comments on the 4-Square Test (9/21, 43%). Students had a statistically significantly higher number of negative usability comments compared with faculty (W=5.7; P=.02), specifically for the 5-Time Sit-to-Stand (W=5.3; P=.02). Themes emerged related to variable knowledge about the standardized tests, value as a teaching and learning tool, technology being consistent with clinical reasoning in addition to ensuring reliability, expert-to-novice clinical reasoning (students), and usability. CONCLUSIONS: The VSTEP Examination Suite was found to be useful by both faculty and students. Reasons for perceived usefulness had some overlap, but there were also differences based on role and experience. Usability testing revealed opportunities for technology refinement. The development of the technology by interdisciplinary teams and testing with multiple types of users may increase adoption. JMIR Publications 2023-08-10 /pmc/articles/PMC10450535/ /pubmed/37561552 http://dx.doi.org/10.2196/44361 Text en ©Judith E Deutsch, John L Palmieri, Holly Gorin, Augustus Wendell, Donghee Yvette Wohn, Harish Damodaran. Originally published in JMIR Medical Education (https://mededu.jmir.org), 10.08.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on https://mededu.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Deutsch, Judith E Palmieri, John L Gorin, Holly Wendell, Augustus Wohn, Donghee Yvette Damodaran, Harish Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title | Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title_full | Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title_fullStr | Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title_full_unstemmed | Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title_short | Student and Faculty Perspectives on the Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons After Stroke: Mixed Methods Study |
title_sort | student and faculty perspectives on the usefulness and usability of a digital health educational tool to teach standardized assessment of persons after stroke: mixed methods study |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10450535/ https://www.ncbi.nlm.nih.gov/pubmed/37561552 http://dx.doi.org/10.2196/44361 |
work_keys_str_mv | AT deutschjudithe studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy AT palmierijohnl studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy AT gorinholly studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy AT wendellaugustus studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy AT wohndongheeyvette studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy AT damodaranharish studentandfacultyperspectivesontheusefulnessandusabilityofadigitalhealtheducationaltooltoteachstandardizedassessmentofpersonsafterstrokemixedmethodsstudy |