Cargando…

A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers

The Earable device is a behind-the-ear wearable originally developed to measure cognitive function. Since Earable measures electroencephalography (EEG), electromyography (EMG), and electrooculography (EOG), it may also have the potential to objectively quantify facial muscle and eye movement activit...

Descripción completa

Detalles Bibliográficos
Autores principales: Wipperman, Matthew F., Pogoncheff, Galen, Mateo, Katrina F., Wu, Xuefang, Chen, Yiziying, Levy, Oren, Avbersek, Andreja, Deterding, Robin R., Hamon, Sara C., Vu, Tam, Alaj, Rinol, Harari, Olivier
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9931353/
https://www.ncbi.nlm.nih.gov/pubmed/36812552
http://dx.doi.org/10.1371/journal.pdig.0000061
_version_ 1784889230478016512
author Wipperman, Matthew F.
Pogoncheff, Galen
Mateo, Katrina F.
Wu, Xuefang
Chen, Yiziying
Levy, Oren
Avbersek, Andreja
Deterding, Robin R.
Hamon, Sara C.
Vu, Tam
Alaj, Rinol
Harari, Olivier
author_facet Wipperman, Matthew F.
Pogoncheff, Galen
Mateo, Katrina F.
Wu, Xuefang
Chen, Yiziying
Levy, Oren
Avbersek, Andreja
Deterding, Robin R.
Hamon, Sara C.
Vu, Tam
Alaj, Rinol
Harari, Olivier
author_sort Wipperman, Matthew F.
collection PubMed
description The Earable device is a behind-the-ear wearable originally developed to measure cognitive function. Since Earable measures electroencephalography (EEG), electromyography (EMG), and electrooculography (EOG), it may also have the potential to objectively quantify facial muscle and eye movement activities relevant in the assessment of neuromuscular disorders. As an initial step to developing a digital assessment in neuromuscular disorders, a pilot study was conducted to determine whether the Earable device could be utilized to objectively measure facial muscle and eye movements intended to be representative of Performance Outcome Assessments, (PerfOs) with tasks designed to model clinical PerfOs, referred to as mock-PerfO activities. The specific aims of this study were: To determine whether the Earable raw EMG, EOG, and EEG signals could be processed to extract features describing these waveforms; To determine Earable feature data quality, test re-test reliability, and statistical properties; To determine whether features derived from Earable could be used to determine the difference between various facial muscle and eye movement activities; and, To determine what features and feature types are important for mock-PerfO activity level classification. A total of N = 10 healthy volunteers participated in the study. Each study participant performed 16 mock-PerfOs activities, including talking, chewing, swallowing, eye closure, gazing in different directions, puffing cheeks, chewing an apple, and making various facial expressions. Each activity was repeated four times in the morning and four times at night. A total of 161 summary features were extracted from the EEG, EMG, and EOG bio-sensor data. Feature vectors were used as input to machine learning models to classify the mock-PerfO activities, and model performance was evaluated on a held-out test set. Additionally, a convolutional neural network (CNN) was used to classify low-level representations of the raw bio-sensor data for each task, and model performance was correspondingly evaluated and compared directly to feature classification performance. The model’s prediction accuracy on the Earable device’s classification ability was quantitatively assessed. Study results indicate that Earable can potentially quantify different aspects of facial and eye movements and may be used to differentiate mock-PerfO activities. Specially, Earable was found to differentiate talking, chewing, and swallowing tasks from other tasks with observed F1 scores >0.9. While EMG features contribute to classification accuracy for all tasks, EOG features are important for classifying gaze tasks. Finally, we found that analysis with summary features outperformed a CNN for activity classification. We believe Earable may be used to measure cranial muscle activity relevant for neuromuscular disorder assessment. Classification performance of mock-PerfO activities with summary features enables a strategy for detecting disease-specific signals relative to controls, as well as the monitoring of intra-subject treatment responses. Further testing is needed to evaluate the Earable device in clinical populations and clinical development settings.
format Online
Article
Text
id pubmed-9931353
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-99313532023-02-16 A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers Wipperman, Matthew F. Pogoncheff, Galen Mateo, Katrina F. Wu, Xuefang Chen, Yiziying Levy, Oren Avbersek, Andreja Deterding, Robin R. Hamon, Sara C. Vu, Tam Alaj, Rinol Harari, Olivier PLOS Digit Health Research Article The Earable device is a behind-the-ear wearable originally developed to measure cognitive function. Since Earable measures electroencephalography (EEG), electromyography (EMG), and electrooculography (EOG), it may also have the potential to objectively quantify facial muscle and eye movement activities relevant in the assessment of neuromuscular disorders. As an initial step to developing a digital assessment in neuromuscular disorders, a pilot study was conducted to determine whether the Earable device could be utilized to objectively measure facial muscle and eye movements intended to be representative of Performance Outcome Assessments, (PerfOs) with tasks designed to model clinical PerfOs, referred to as mock-PerfO activities. The specific aims of this study were: To determine whether the Earable raw EMG, EOG, and EEG signals could be processed to extract features describing these waveforms; To determine Earable feature data quality, test re-test reliability, and statistical properties; To determine whether features derived from Earable could be used to determine the difference between various facial muscle and eye movement activities; and, To determine what features and feature types are important for mock-PerfO activity level classification. A total of N = 10 healthy volunteers participated in the study. Each study participant performed 16 mock-PerfOs activities, including talking, chewing, swallowing, eye closure, gazing in different directions, puffing cheeks, chewing an apple, and making various facial expressions. Each activity was repeated four times in the morning and four times at night. A total of 161 summary features were extracted from the EEG, EMG, and EOG bio-sensor data. Feature vectors were used as input to machine learning models to classify the mock-PerfO activities, and model performance was evaluated on a held-out test set. Additionally, a convolutional neural network (CNN) was used to classify low-level representations of the raw bio-sensor data for each task, and model performance was correspondingly evaluated and compared directly to feature classification performance. The model’s prediction accuracy on the Earable device’s classification ability was quantitatively assessed. Study results indicate that Earable can potentially quantify different aspects of facial and eye movements and may be used to differentiate mock-PerfO activities. Specially, Earable was found to differentiate talking, chewing, and swallowing tasks from other tasks with observed F1 scores >0.9. While EMG features contribute to classification accuracy for all tasks, EOG features are important for classifying gaze tasks. Finally, we found that analysis with summary features outperformed a CNN for activity classification. We believe Earable may be used to measure cranial muscle activity relevant for neuromuscular disorder assessment. Classification performance of mock-PerfO activities with summary features enables a strategy for detecting disease-specific signals relative to controls, as well as the monitoring of intra-subject treatment responses. Further testing is needed to evaluate the Earable device in clinical populations and clinical development settings. Public Library of Science 2022-06-30 /pmc/articles/PMC9931353/ /pubmed/36812552 http://dx.doi.org/10.1371/journal.pdig.0000061 Text en © 2022 Wipperman et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Wipperman, Matthew F.
Pogoncheff, Galen
Mateo, Katrina F.
Wu, Xuefang
Chen, Yiziying
Levy, Oren
Avbersek, Andreja
Deterding, Robin R.
Hamon, Sara C.
Vu, Tam
Alaj, Rinol
Harari, Olivier
A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title_full A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title_fullStr A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title_full_unstemmed A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title_short A pilot study of the Earable device to measure facial muscle and eye movement tasks among healthy volunteers
title_sort pilot study of the earable device to measure facial muscle and eye movement tasks among healthy volunteers
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9931353/
https://www.ncbi.nlm.nih.gov/pubmed/36812552
http://dx.doi.org/10.1371/journal.pdig.0000061
work_keys_str_mv AT wippermanmatthewf apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT pogoncheffgalen apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT mateokatrinaf apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT wuxuefang apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT chenyiziying apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT levyoren apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT avbersekandreja apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT deterdingrobinr apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT hamonsarac apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT vutam apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT alajrinol apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT harariolivier apilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT wippermanmatthewf pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT pogoncheffgalen pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT mateokatrinaf pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT wuxuefang pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT chenyiziying pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT levyoren pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT avbersekandreja pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT deterdingrobinr pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT hamonsarac pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT vutam pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT alajrinol pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers
AT harariolivier pilotstudyoftheearabledevicetomeasurefacialmuscleandeyemovementtasksamonghealthyvolunteers