Cargando…
Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologi...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The British Editorial Society of Bone & Joint Surgery
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10032230/ https://www.ncbi.nlm.nih.gov/pubmed/37051835 http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1 |
_version_ | 1784910752377733120 |
---|---|
author | Boyer, Philip Burns, David Whyne, Cari |
author_facet | Boyer, Philip Burns, David Whyne, Cari |
author_sort | Boyer, Philip |
collection | PubMed |
description | AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologies for detecting and classifying inertial data collected during in-clinic and at-home shoulder physiotherapy exercise. METHODS: A smartwatch was used to collect inertial data from 42 patients performing shoulder physiotherapy exercises for rotator cuff injuries in both in-clinic and at-home settings. A two-stage ML approach was used to detect out-of-distribution (OOD) data (to remove non-exercise data) and subsequently for classification of exercises. We evaluated the performance impact of grouping exercises by motion type, inclusion of non-exercise data for algorithm training, and a patient-specific approach to exercise classification. Algorithm performance was evaluated using both in-clinic and at-home data. RESULTS: The patient-specific approach with engineered features achieved the highest in-clinic performance for differentiating physiotherapy exercise from non-exercise activity (area under the receiver operating characteristic (AUROC) = 0.924). Including non-exercise data in algorithm training further improved classifier performance (random forest, AUROC = 0.985). The highest accuracy achieved for classifying individual in-clinic exercises was 0.903, using a patient-specific method with deep neural network model extracted features. Grouping exercises by motion type improved exercise classification. For at-home data, OOD detection yielded similar performance with the non-exercise data in the algorithm training (fully convolutional network AUROC = 0.919). CONCLUSION: Including non-exercise data in algorithm training improves detection of exercises. A patient-specific approach leveraging data from earlier patient-supervised sessions should be considered but is highly dependent on per-patient data quality. Cite this article: Bone Joint Res 2023;12(3):165–177. |
format | Online Article Text |
id | pubmed-10032230 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | The British Editorial Society of Bone & Joint Surgery |
record_format | MEDLINE/PubMed |
spelling | pubmed-100322302023-03-23 Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors Boyer, Philip Burns, David Whyne, Cari Bone Joint Res Upper Limb AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologies for detecting and classifying inertial data collected during in-clinic and at-home shoulder physiotherapy exercise. METHODS: A smartwatch was used to collect inertial data from 42 patients performing shoulder physiotherapy exercises for rotator cuff injuries in both in-clinic and at-home settings. A two-stage ML approach was used to detect out-of-distribution (OOD) data (to remove non-exercise data) and subsequently for classification of exercises. We evaluated the performance impact of grouping exercises by motion type, inclusion of non-exercise data for algorithm training, and a patient-specific approach to exercise classification. Algorithm performance was evaluated using both in-clinic and at-home data. RESULTS: The patient-specific approach with engineered features achieved the highest in-clinic performance for differentiating physiotherapy exercise from non-exercise activity (area under the receiver operating characteristic (AUROC) = 0.924). Including non-exercise data in algorithm training further improved classifier performance (random forest, AUROC = 0.985). The highest accuracy achieved for classifying individual in-clinic exercises was 0.903, using a patient-specific method with deep neural network model extracted features. Grouping exercises by motion type improved exercise classification. For at-home data, OOD detection yielded similar performance with the non-exercise data in the algorithm training (fully convolutional network AUROC = 0.919). CONCLUSION: Including non-exercise data in algorithm training improves detection of exercises. A patient-specific approach leveraging data from earlier patient-supervised sessions should be considered but is highly dependent on per-patient data quality. Cite this article: Bone Joint Res 2023;12(3):165–177. The British Editorial Society of Bone & Joint Surgery 2023-03-01 /pmc/articles/PMC10032230/ /pubmed/37051835 http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1 Text en © 2023 Author(s) et al. https://creativecommons.org/licenses/by/4.0/https://online.boneandjoint.org.uk/TDM Open Access This article is distributed under the terms of the Creative Commons Attributions (CC BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original author and source are credited. |
spellingShingle | Upper Limb Boyer, Philip Burns, David Whyne, Cari Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title | Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title_full | Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title_fullStr | Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title_full_unstemmed | Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title_short | Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
title_sort | evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors |
topic | Upper Limb |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10032230/ https://www.ncbi.nlm.nih.gov/pubmed/37051835 http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1 |
work_keys_str_mv | AT boyerphilip evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors AT burnsdavid evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors AT whynecari evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors |