Cargando…
A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery
Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information containe...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7982728/ https://www.ncbi.nlm.nih.gov/pubmed/33762911 http://dx.doi.org/10.3389/fnhum.2021.595723 |
_version_ | 1783667779697639424 |
---|---|
author | Wu, Fan Gong, Anmin Li, Hongyun Zhao, Lei Zhang, Wei Fu, Yunfa |
author_facet | Wu, Fan Gong, Anmin Li, Hongyun Zhao, Lei Zhang, Wei Fu, Yunfa |
author_sort | Wu, Fan |
collection | PubMed |
description | Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information contained in the covariance matrix, and can extract more abundant and effective features. Moreover, the method is an unsupervised operation, which can reduce the time of feature extraction. However, EEG features induced by MI mental activities of different subjects are not the same, so selection of subject-specific discriminative EEG frequency components play a vital role in the recognition of multiclass MI. In order to solve the problem, a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm is proposed in this article to design the subject-specific Filter Bank (FB) so as to effectively recognize multiclass MI tasks. Methods: On the 4-class BCI competition IV-2a dataset, first, a non-parametric method of multivariate analysis of variance (MANOVA) based on the sum of squared distances is used to select discriminative frequency bands for a subject; next, a multi-scale FB is generated according to the range of these frequency bands, and then decompose multi-channel EEG of the subject into multiple sub-bands combined with several time windows. Then TSM algorithm is used to estimate Riemannian tangent space features in each sub-band and finally a liner Support Vector Machines (SVM) is used for classification. Main Results: The analysis results show that the proposed discriminative FB enhances the multi-scale TSM algorithm, improves the classification accuracy and reduces the execution time during training and testing. On the 4-class BCI competition IV-2a dataset, the average session to session classification accuracy of nine subjects reached 77.33 ± 12.3%. When the training time and the test time are similar, the average classification accuracy is 2.56% higher than the latest TSM method based on multi-scale filter bank analysis technology. When the classification accuracy is similar, the training speed is increased by more than three times, and the test speed is increased two times more. Compared with Supervised Fisher Geodesic Minimum Distance to the Mean (Supervised FGMDRM), another new variant based on Riemann geometry classifier, the average accuracy is 3.36% higher, we also compared with the latest Deep Learning method, and the average accuracy of 10-fold cross validation improved by 2.58%. Conclusion: Research shows that the proposed DMFBTSM algorithm can improve the classification accuracy of MI tasks. Significance: Compared with the MFBTSM algorithm, the algorithm proposed in this article is expected to select frequency bands with good separability for specific subject to improve the classification accuracy of multiclass MI tasks and reduce the feature dimension to reduce training time and testing time. |
format | Online Article Text |
id | pubmed-7982728 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79827282021-03-23 A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery Wu, Fan Gong, Anmin Li, Hongyun Zhao, Lei Zhang, Wei Fu, Yunfa Front Hum Neurosci Neuroscience Objective: Tangent Space Mapping (TSM) using the geometric structure of the covariance matrices is an effective method to recognize multiclass motor imagery (MI). Compared with the traditional CSP method, the Riemann geometric method based on TSM takes into account the nonlinear information contained in the covariance matrix, and can extract more abundant and effective features. Moreover, the method is an unsupervised operation, which can reduce the time of feature extraction. However, EEG features induced by MI mental activities of different subjects are not the same, so selection of subject-specific discriminative EEG frequency components play a vital role in the recognition of multiclass MI. In order to solve the problem, a discriminative and multi-scale filter bank tangent space mapping (DMFBTSM) algorithm is proposed in this article to design the subject-specific Filter Bank (FB) so as to effectively recognize multiclass MI tasks. Methods: On the 4-class BCI competition IV-2a dataset, first, a non-parametric method of multivariate analysis of variance (MANOVA) based on the sum of squared distances is used to select discriminative frequency bands for a subject; next, a multi-scale FB is generated according to the range of these frequency bands, and then decompose multi-channel EEG of the subject into multiple sub-bands combined with several time windows. Then TSM algorithm is used to estimate Riemannian tangent space features in each sub-band and finally a liner Support Vector Machines (SVM) is used for classification. Main Results: The analysis results show that the proposed discriminative FB enhances the multi-scale TSM algorithm, improves the classification accuracy and reduces the execution time during training and testing. On the 4-class BCI competition IV-2a dataset, the average session to session classification accuracy of nine subjects reached 77.33 ± 12.3%. When the training time and the test time are similar, the average classification accuracy is 2.56% higher than the latest TSM method based on multi-scale filter bank analysis technology. When the classification accuracy is similar, the training speed is increased by more than three times, and the test speed is increased two times more. Compared with Supervised Fisher Geodesic Minimum Distance to the Mean (Supervised FGMDRM), another new variant based on Riemann geometry classifier, the average accuracy is 3.36% higher, we also compared with the latest Deep Learning method, and the average accuracy of 10-fold cross validation improved by 2.58%. Conclusion: Research shows that the proposed DMFBTSM algorithm can improve the classification accuracy of MI tasks. Significance: Compared with the MFBTSM algorithm, the algorithm proposed in this article is expected to select frequency bands with good separability for specific subject to improve the classification accuracy of multiclass MI tasks and reduce the feature dimension to reduce training time and testing time. Frontiers Media S.A. 2021-03-08 /pmc/articles/PMC7982728/ /pubmed/33762911 http://dx.doi.org/10.3389/fnhum.2021.595723 Text en Copyright © 2021 Wu, Gong, Li, Zhao, Zhang and Fu. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Wu, Fan Gong, Anmin Li, Hongyun Zhao, Lei Zhang, Wei Fu, Yunfa A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title | A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title_full | A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title_fullStr | A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title_full_unstemmed | A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title_short | A New Subject-Specific Discriminative and Multi-Scale Filter Bank Tangent Space Mapping Method for Recognition of Multiclass Motor Imagery |
title_sort | new subject-specific discriminative and multi-scale filter bank tangent space mapping method for recognition of multiclass motor imagery |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7982728/ https://www.ncbi.nlm.nih.gov/pubmed/33762911 http://dx.doi.org/10.3389/fnhum.2021.595723 |
work_keys_str_mv | AT wufan anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT gonganmin anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT lihongyun anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT zhaolei anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT zhangwei anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT fuyunfa anewsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT wufan newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT gonganmin newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT lihongyun newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT zhaolei newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT zhangwei newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery AT fuyunfa newsubjectspecificdiscriminativeandmultiscalefilterbanktangentspacemappingmethodforrecognitionofmulticlassmotorimagery |