Cargando…

Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces

Invasive brain-computer interfaces yield remarkable performance in a multitude of applications. For classification experiments, high-gamma bandpower features and linear discriminant analysis (LDA) are commonly used due to simplicity and robustness. However, LDA is inherently static and not suited to...

Descripción completa

Detalles Bibliográficos
Autores principales: Gruenwald, Johannes, Znobishchev, Andrei, Kapeller, Christoph, Kamada, Kyousuke, Scharinger, Josef, Guger, Christoph
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6775278/
https://www.ncbi.nlm.nih.gov/pubmed/31616237
http://dx.doi.org/10.3389/fnins.2019.00901
_version_ 1783456208875683840
author Gruenwald, Johannes
Znobishchev, Andrei
Kapeller, Christoph
Kamada, Kyousuke
Scharinger, Josef
Guger, Christoph
author_facet Gruenwald, Johannes
Znobishchev, Andrei
Kapeller, Christoph
Kamada, Kyousuke
Scharinger, Josef
Guger, Christoph
author_sort Gruenwald, Johannes
collection PubMed
description Invasive brain-computer interfaces yield remarkable performance in a multitude of applications. For classification experiments, high-gamma bandpower features and linear discriminant analysis (LDA) are commonly used due to simplicity and robustness. However, LDA is inherently static and not suited to account for transient information that is typically present in high-gamma features. To resolve this issue, we here present an extension of LDA to the time-variant feature space. We call this method time-variant linear discriminant analysis (TVLDA). It intrinsically provides a feature reduction stage, which makes external approaches thereto obsolete, such as feature selection techniques or common spatial patterns (CSPs). As well, we propose a time-domain whitening stage which equalizes the pronounced 1/f-shape of the typical brain-wave spectrum. We evaluated our proposed architecture based on recordings from 15 epilepsy patients with temporarily implanted subdural grids, who participated in additional research experiments besides clinical treatment. The experiments featured two different motor tasks involving three high-level gestures and individual finger movement. We used log-transformed bandpower features from the high-gamma band (50–300 Hz, excluding power-line harmonics) for classification. On average, whitening improved the classification performance by about 11%. On whitened data, TVLDA outperformed LDA with feature selection by 11.8%, LDA with CSPs by 13.9%, and regularized LDA with vectorized features by 16.4%. At the same time, TVLDA only required one or two internal features to achieve this. TVLDA provides stable results even if very few trials are available. It is easy to implement, fully automatic and deterministic. Due to its low complexity, TVLDA is suited for real-time brain-computer interfaces. Training is done in less than a second. TVLDA performed particularly well in experiments with data from high-density electrode arrays. For example, the three high-level gestures were correctly identified at a rate of 99% over all subjects. Similarly, the decoding accuracy of individual fingers was 96% on average over all subjects. To our knowledge, these mean accuracies are the highest ever reported for three-class and five-class motor-control BCIs.
format Online
Article
Text
id pubmed-6775278
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-67752782019-10-15 Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces Gruenwald, Johannes Znobishchev, Andrei Kapeller, Christoph Kamada, Kyousuke Scharinger, Josef Guger, Christoph Front Neurosci Neuroscience Invasive brain-computer interfaces yield remarkable performance in a multitude of applications. For classification experiments, high-gamma bandpower features and linear discriminant analysis (LDA) are commonly used due to simplicity and robustness. However, LDA is inherently static and not suited to account for transient information that is typically present in high-gamma features. To resolve this issue, we here present an extension of LDA to the time-variant feature space. We call this method time-variant linear discriminant analysis (TVLDA). It intrinsically provides a feature reduction stage, which makes external approaches thereto obsolete, such as feature selection techniques or common spatial patterns (CSPs). As well, we propose a time-domain whitening stage which equalizes the pronounced 1/f-shape of the typical brain-wave spectrum. We evaluated our proposed architecture based on recordings from 15 epilepsy patients with temporarily implanted subdural grids, who participated in additional research experiments besides clinical treatment. The experiments featured two different motor tasks involving three high-level gestures and individual finger movement. We used log-transformed bandpower features from the high-gamma band (50–300 Hz, excluding power-line harmonics) for classification. On average, whitening improved the classification performance by about 11%. On whitened data, TVLDA outperformed LDA with feature selection by 11.8%, LDA with CSPs by 13.9%, and regularized LDA with vectorized features by 16.4%. At the same time, TVLDA only required one or two internal features to achieve this. TVLDA provides stable results even if very few trials are available. It is easy to implement, fully automatic and deterministic. Due to its low complexity, TVLDA is suited for real-time brain-computer interfaces. Training is done in less than a second. TVLDA performed particularly well in experiments with data from high-density electrode arrays. For example, the three high-level gestures were correctly identified at a rate of 99% over all subjects. Similarly, the decoding accuracy of individual fingers was 96% on average over all subjects. To our knowledge, these mean accuracies are the highest ever reported for three-class and five-class motor-control BCIs. Frontiers Media S.A. 2019-09-26 /pmc/articles/PMC6775278/ /pubmed/31616237 http://dx.doi.org/10.3389/fnins.2019.00901 Text en Copyright © 2019 Gruenwald, Znobishchev, Kapeller, Kamada, Scharinger and Guger. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Gruenwald, Johannes
Znobishchev, Andrei
Kapeller, Christoph
Kamada, Kyousuke
Scharinger, Josef
Guger, Christoph
Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title_full Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title_fullStr Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title_full_unstemmed Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title_short Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces
title_sort time-variant linear discriminant analysis improves hand gesture and finger movement decoding for invasive brain-computer interfaces
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6775278/
https://www.ncbi.nlm.nih.gov/pubmed/31616237
http://dx.doi.org/10.3389/fnins.2019.00901
work_keys_str_mv AT gruenwaldjohannes timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces
AT znobishchevandrei timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces
AT kapellerchristoph timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces
AT kamadakyousuke timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces
AT scharingerjosef timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces
AT gugerchristoph timevariantlineardiscriminantanalysisimproveshandgestureandfingermovementdecodingforinvasivebraincomputerinterfaces