Cargando…

A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery

Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information containe...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Fan, Gong, Anmin, Li, Hongyun, Zhao, Lei, Zhang, Wei, Fu, Yunfa
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7982728/
https://www.ncbi.nlm.nih.gov/pubmed/33762911
http://dx.doi.org/10.3389/fnhum.2021.595723
_version_ 1783667779697639424
author Wu, Fan
Gong, Anmin
Li, Hongyun
Zhao, Lei
Zhang, Wei
Fu, Yunfa
author_facet Wu, Fan
Gong, Anmin
Li, Hongyun
Zhao, Lei
Zhang, Wei
Fu, Yunfa
author_sort Wu, Fan
collection PubMed
description Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information contained in the covariance matrix, and can extract more abundant and effective features. Moreover, the method is an unsupervised operation, which can reduce the time of feature extraction. However, EEG features induced by MI mental activities of different subjects are not the same, so selection of subject-specific discriminative EEG frequency components play a vital role in the recognition of multiclass MI. In order to solve the problem, a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm is proposed in this article to design the subject-specific Filter Bank (FB) so as to effectively recognize multiclass MI tasks. Methods: On the 4-class BCI competition IV-2a dataset, first, a non-parametric method of multivariate analysis of variance (MANOVA) based on the sum of squared distances is used to select discriminative frequency bands for a subject; next, a multi-scale FB is generated according to the range of these frequency bands, and then decompose multi-channel EEG of the subject into multiple sub-bands combined with several time windows. Then TSM algorithm is used to estimate Riemannian tangent space features in each sub-band and finally a liner Support Vector Machines (SVM) is used for classification. Main Results: The analysis results show that the proposed discriminative FB enhances the multi-scale TSM algorithm, improves the classification accuracy and reduces the execution time during training and testing. On the 4-class BCI competition IV-2a dataset, the average session to session classification accuracy of nine subjects reached 77.33 ± 12.3%. When the training time and the test time are similar, the average classification accuracy is 2.56% higher than the latest TSM method based on multi-scale filter bank analysis technology. When the classification accuracy is similar, the training speed is increased by more than three times, and the test speed is increased two times more. Compared with Supervised Fisher Geodesic Minimum Distance to the Mean (Supervised FGMDRM), another new variant based on Riemann geometry classifier, the average accuracy is 3.36% higher, we also compared with the latest Deep Learning method, and the average accuracy of 10-fold cross validation improved by 2.58%. Conclusion: Research shows that the proposed DMFBTSM algorithm can improve the classification accuracy of MI tasks. Significance: Compared with the MFBTSM algorithm, the algorithm proposed in this article is expected to select frequency bands with good separability for specific subject to improve the classification accuracy of multiclass MI tasks and reduce the feature dimension to reduce training time and testing time.
format Online
Article
Text
id pubmed-7982728
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-79827282021-03-23 A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery Wu, Fan Gong, Anmin Li, Hongyun Zhao, Lei Zhang, Wei Fu, Yunfa Front Hum Neurosci Neuroscience Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information contained in the covariance matrix, and can extract more abundant and effective features. Moreover, the method is an unsupervised operation, which can reduce the time of feature extraction. However, EEG features induced by MI mental activities of different subjects are not the same, so selection of subject-specific discriminative EEG frequency components play a vital role in the recognition of multiclass MI. In order to solve the problem, a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm is proposed in this article to design the subject-specific Filter Bank (FB) so as to effectively recognize multiclass MI tasks. Methods: On the 4-class BCI competition IV-2a dataset, first, a non-parametric method of multivariate analysis of variance (MANOVA) based on the sum of squared distances is used to select discriminative frequency bands for a subject; next, a multi-scale FB is generated according to the range of these frequency bands, and then decompose multi-channel EEG of the subject into multiple sub-bands combined with several time windows. Then TSM algorithm is used to estimate Riemannian tangent space features in each sub-band and finally a liner Support Vector Machines (SVM) is used for classification. Main Results: The analysis results show that the proposed discriminative FB enhances the multi-scale TSM algorithm, improves the classification accuracy and reduces the execution time during training and testing. On the 4-class BCI competition IV-2a dataset, the average session to session classification accuracy of nine subjects reached 77.33 ± 12.3%. When the training time and the test time are similar, the average classification accuracy is 2.56% higher than the latest TSM method based on multi-scale filter bank analysis technology. When the classification accuracy is similar, the training speed is increased by more than three times, and the test speed is increased two times more. Compared with Supervised Fisher Geodesic Minimum Distance to the Mean (Supervised FGMDRM), another new variant based on Riemann geometry classifier, the average accuracy is 3.36% higher, we also compared with the latest Deep Learning method, and the average accuracy of 10-fold cross validation improved by 2.58%. Conclusion: Research shows that the proposed DMFBTSM algorithm can improve the classification accuracy of MI tasks. Significance: Compared with the MFBTSM algorithm, the algorithm proposed in this article is expected to select frequency bands with good separability for specific subject to improve the classification accuracy of multiclass MI tasks and reduce the feature dimension to reduce training time and testing time. Frontiers Media S.A. 2021-03-08 /pmc/articles/PMC7982728/ /pubmed/33762911 http://dx.doi.org/10.3389/fnhum.2021.595723 Text en Copyright © 2021 Wu, Gong, Li, Zhao, Zhang and Fu. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Wu, Fan
Gong, Anmin
Li, Hongyun
Zhao, Lei
Zhang, Wei
Fu, Yunfa
A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title_full A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title_fullStr A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title_full_unstemmed A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title_short A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
title_sort new subject-specific discriminative and multi-scale filter bank tangent space mapping method for recognition of multiclass motor imagery
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7982728/
https://www.ncbi.nlm.nih.gov/pubmed/33762911
http://dx.doi.org/10.3389/fnhum.2021.595723
work_keys_str_mv AT wufan anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT gonganmin anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT lihongyun anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT zhaolei anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT zhangwei anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT fuyunfa anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT wufan newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT gonganmin newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT lihongyun newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT zhaolei newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT zhangwei newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery
AT fuyunfa newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery