Cargando…

Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors

AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologi...

Descripción completa

Detalles Bibliográficos
Autores principales: Boyer, Philip, Burns, David, Whyne, Cari
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The British Editorial Society of Bone & Joint Surgery 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10032230/
https://www.ncbi.nlm.nih.gov/pubmed/37051835
http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1
_version_ 1784910752377733120
author Boyer, Philip
Burns, David
Whyne, Cari
author_facet Boyer, Philip
Burns, David
Whyne, Cari
author_sort Boyer, Philip
collection PubMed
description AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologies for detecting and classifying inertial data collected during in-clinic and at-home shoulder physiotherapy exercise. METHODS: A smartwatch was used to collect inertial data from 42 patients performing shoulder physiotherapy exercises for rotator cuff injuries in both in-clinic and at-home settings. A two-stage ML approach was used to detect out-of-distribution (OOD) data (to remove non-exercise data) and subsequently for classification of exercises. We evaluated the performance impact of grouping exercises by motion type, inclusion of non-exercise data for algorithm training, and a patient-specific approach to exercise classification. Algorithm performance was evaluated using both in-clinic and at-home data. RESULTS: The patient-specific approach with engineered features achieved the highest in-clinic performance for differentiating physiotherapy exercise from non-exercise activity (area under the receiver operating characteristic (AUROC) = 0.924). Including non-exercise data in algorithm training further improved classifier performance (random forest, AUROC = 0.985). The highest accuracy achieved for classifying individual in-clinic exercises was 0.903, using a patient-specific method with deep neural network model extracted features. Grouping exercises by motion type improved exercise classification. For at-home data, OOD detection yielded similar performance with the non-exercise data in the algorithm training (fully convolutional network AUROC = 0.919). CONCLUSION: Including non-exercise data in algorithm training improves detection of exercises. A patient-specific approach leveraging data from earlier patient-supervised sessions should be considered but is highly dependent on per-patient data quality. Cite this article: Bone Joint Res 2023;12(3):165–177.
format Online
Article
Text
id pubmed-10032230
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher The British Editorial Society of Bone & Joint Surgery
record_format MEDLINE/PubMed
spelling pubmed-100322302023-03-23 Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors Boyer, Philip Burns, David Whyne, Cari Bone Joint Res Upper Limb AIMS: An objective technological solution for tracking adherence to at-home shoulder physiotherapy is important for improving patient engagement and rehabilitation outcomes, but remains a significant challenge. The aim of this research was to evaluate performance of machine-learning (ML) methodologies for detecting and classifying inertial data collected during in-clinic and at-home shoulder physiotherapy exercise. METHODS: A smartwatch was used to collect inertial data from 42 patients performing shoulder physiotherapy exercises for rotator cuff injuries in both in-clinic and at-home settings. A two-stage ML approach was used to detect out-of-distribution (OOD) data (to remove non-exercise data) and subsequently for classification of exercises. We evaluated the performance impact of grouping exercises by motion type, inclusion of non-exercise data for algorithm training, and a patient-specific approach to exercise classification. Algorithm performance was evaluated using both in-clinic and at-home data. RESULTS: The patient-specific approach with engineered features achieved the highest in-clinic performance for differentiating physiotherapy exercise from non-exercise activity (area under the receiver operating characteristic (AUROC) = 0.924). Including non-exercise data in algorithm training further improved classifier performance (random forest, AUROC = 0.985). The highest accuracy achieved for classifying individual in-clinic exercises was 0.903, using a patient-specific method with deep neural network model extracted features. Grouping exercises by motion type improved exercise classification. For at-home data, OOD detection yielded similar performance with the non-exercise data in the algorithm training (fully convolutional network AUROC = 0.919). CONCLUSION: Including non-exercise data in algorithm training improves detection of exercises. A patient-specific approach leveraging data from earlier patient-supervised sessions should be considered but is highly dependent on per-patient data quality. Cite this article: Bone Joint Res 2023;12(3):165–177. The British Editorial Society of Bone & Joint Surgery 2023-03-01 /pmc/articles/PMC10032230/ /pubmed/37051835 http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1 Text en © 2023 Author(s) et al. https://creativecommons.org/licenses/by/4.0/https://online.boneandjoint.org.uk/TDM Open Access This article is distributed under the terms of the Creative Commons Attributions (CC BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium or format, provided the original author and source are credited.
spellingShingle Upper Limb
Boyer, Philip
Burns, David
Whyne, Cari
Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title_full Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title_fullStr Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title_full_unstemmed Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title_short Evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
title_sort evaluation of at-home physiotherapy: machine-learning prediction with smart watch inertial sensors
topic Upper Limb
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10032230/
https://www.ncbi.nlm.nih.gov/pubmed/37051835
http://dx.doi.org/10.1302/2046-3758.123.BJR-2022-0126.R1
work_keys_str_mv AT boyerphilip evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors
AT burnsdavid evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors
AT whynecari evaluationofathomephysiotherapymachinelearningpredictionwithsmartwatchinertialsensors