Cargando…
A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease
Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson’s disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessme...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8399017/ https://www.ncbi.nlm.nih.gov/pubmed/34450879 http://dx.doi.org/10.3390/s21165437 |
_version_ | 1783744976347201536 |
---|---|
author | Rupprechter, Samuel Morinan, Gareth Peng, Yuwei Foltynie, Thomas Sibley, Krista Weil, Rimona S. Leyland, Louise-Ann Baig, Fahd Morgante, Francesca Gilron, Ro’ee Wilt, Robert Starr, Philip Hauser, Robert A. O’Keeffe, Jonathan |
author_facet | Rupprechter, Samuel Morinan, Gareth Peng, Yuwei Foltynie, Thomas Sibley, Krista Weil, Rimona S. Leyland, Louise-Ann Baig, Fahd Morgante, Francesca Gilron, Ro’ee Wilt, Robert Starr, Philip Hauser, Robert A. O’Keeffe, Jonathan |
author_sort | Rupprechter, Samuel |
collection | PubMed |
description | Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson’s disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson’s disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician—for example, during remote home assessments. Videos ([Formula: see text]) were collected as part of routine MDS-UPDRS gait assessments of Parkinson’s patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson’s [Formula: see text] , [Formula: see text]). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians’ ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman’s [Formula: see text] , [Formula: see text]). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model’s objective UPDRS rating estimation. The severity of gait impairment in Parkinson’s disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring. |
format | Online Article Text |
id | pubmed-8399017 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-83990172021-08-29 A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease Rupprechter, Samuel Morinan, Gareth Peng, Yuwei Foltynie, Thomas Sibley, Krista Weil, Rimona S. Leyland, Louise-Ann Baig, Fahd Morgante, Francesca Gilron, Ro’ee Wilt, Robert Starr, Philip Hauser, Robert A. O’Keeffe, Jonathan Sensors (Basel) Article Gait is a core motor function and is impaired in numerous neurological diseases, including Parkinson’s disease (PD). Treatment changes in PD are frequently driven by gait assessments in the clinic, commonly rated as part of the Movement Disorder Society (MDS) Unified PD Rating Scale (UPDRS) assessment (item 3.10). We proposed and evaluated a novel approach for estimating severity of gait impairment in Parkinson’s disease using a computer vision-based methodology. The system we developed can be used to obtain an estimate for a rating to catch potential errors, or to gain an initial rating in the absence of a trained clinician—for example, during remote home assessments. Videos ([Formula: see text]) were collected as part of routine MDS-UPDRS gait assessments of Parkinson’s patients, and a deep learning library was used to extract body key-point coordinates for each frame. Data were recorded at five clinical sites using commercially available mobile phones or tablets, and had an associated severity rating from a trained clinician. Six features were calculated from time-series signals of the extracted key-points. These features characterized key aspects of the movement including speed (step frequency, estimated using a novel Gamma-Poisson Bayesian model), arm swing, postural control and smoothness (or roughness) of movement. An ordinal random forest classification model (with one class for each of the possible ratings) was trained and evaluated using 10-fold cross validation. Step frequency point estimates from the Bayesian model were highly correlated with manually labelled step frequencies of 606 video clips showing patients walking towards or away from the camera (Pearson’s [Formula: see text] , [Formula: see text]). Our classifier achieved a balanced accuracy of 50% (chance = 25%). Estimated UPDRS ratings were within one of the clinicians’ ratings in 95% of cases. There was a significant correlation between clinician labels and model estimates (Spearman’s [Formula: see text] , [Formula: see text]). We show how the interpretability of the feature values could be used by clinicians to support their decision-making and provide insight into the model’s objective UPDRS rating estimation. The severity of gait impairment in Parkinson’s disease can be estimated using a single patient video, recorded using a consumer mobile device and within standard clinical settings; i.e., videos were recorded in various hospital hallways and offices rather than gait laboratories. This approach can support clinicians during routine assessments by providing an objective rating (or second opinion), and has the potential to be used for remote home assessments, which would allow for more frequent monitoring. MDPI 2021-08-12 /pmc/articles/PMC8399017/ /pubmed/34450879 http://dx.doi.org/10.3390/s21165437 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Rupprechter, Samuel Morinan, Gareth Peng, Yuwei Foltynie, Thomas Sibley, Krista Weil, Rimona S. Leyland, Louise-Ann Baig, Fahd Morgante, Francesca Gilron, Ro’ee Wilt, Robert Starr, Philip Hauser, Robert A. O’Keeffe, Jonathan A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title | A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title_full | A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title_fullStr | A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title_full_unstemmed | A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title_short | A Clinically Interpretable Computer-Vision Based Method for Quantifying Gait in Parkinson’s Disease |
title_sort | clinically interpretable computer-vision based method for quantifying gait in parkinson’s disease |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8399017/ https://www.ncbi.nlm.nih.gov/pubmed/34450879 http://dx.doi.org/10.3390/s21165437 |
work_keys_str_mv | AT rupprechtersamuel aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT morinangareth aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT pengyuwei aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT foltyniethomas aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT sibleykrista aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT weilrimonas aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT leylandlouiseann aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT baigfahd aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT morgantefrancesca aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT gilronroee aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT wiltrobert aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT starrphilip aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT hauserroberta aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT okeeffejonathan aclinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT rupprechtersamuel clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT morinangareth clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT pengyuwei clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT foltyniethomas clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT sibleykrista clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT weilrimonas clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT leylandlouiseann clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT baigfahd clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT morgantefrancesca clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT gilronroee clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT wiltrobert clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT starrphilip clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT hauserroberta clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease AT okeeffejonathan clinicallyinterpretablecomputervisionbasedmethodforquantifyinggaitinparkinsonsdisease |