Cargando…
A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification
Convolutional neural networks (CNNs) have been widely applied to the motor imagery (MI) classification field, significantly improving the state-of-the-art (SoA) performance in terms of classification accuracy. Although innovative model structures are thoroughly explored, little attention was drawn t...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8570040/ https://www.ncbi.nlm.nih.gov/pubmed/34744622 http://dx.doi.org/10.3389/fnins.2021.760979 |
_version_ | 1784594762772250624 |
---|---|
author | Huang, Xiuyu Zhou, Nan Choi, Kup-Sze |
author_facet | Huang, Xiuyu Zhou, Nan Choi, Kup-Sze |
author_sort | Huang, Xiuyu |
collection | PubMed |
description | Convolutional neural networks (CNNs) have been widely applied to the motor imagery (MI) classification field, significantly improving the state-of-the-art (SoA) performance in terms of classification accuracy. Although innovative model structures are thoroughly explored, little attention was drawn toward the objective function. In most of the available CNNs in the MI area, the standard cross-entropy loss is usually performed as the objective function, which only ensures deep feature separability. Corresponding to the limitation of current objective functions, a new loss function with a combination of smoothed cross-entropy (with label smoothing) and center loss is proposed as the supervision signal for the model in the MI recognition task. Specifically, the smoothed cross-entropy is calculated by the entropy between the predicted labels and the one-hot hard labels regularized by a noise of uniform distribution. The center loss learns a deep feature center for each class and minimizes the distance between deep features and their corresponding centers. The proposed loss tries to optimize the model in two learning objectives, preventing overconfident predictions and increasing deep feature discriminative capacity (interclass separability and intraclass invariant), which guarantee the effectiveness of MI recognition models. We conduct extensive experiments on two well-known benchmarks (BCI competition IV-2a and IV-2b) to evaluate our method. The result indicates that the proposed approach achieves better performance than other SoA models on both datasets. The proposed learning scheme offers a more robust optimization for the CNN model in the MI classification task, simultaneously decreasing the risk of overfitting and increasing the discriminative power of deeply learned features. |
format | Online Article Text |
id | pubmed-8570040 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-85700402021-11-06 A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification Huang, Xiuyu Zhou, Nan Choi, Kup-Sze Front Neurosci Neuroscience Convolutional neural networks (CNNs) have been widely applied to the motor imagery (MI) classification field, significantly improving the state-of-the-art (SoA) performance in terms of classification accuracy. Although innovative model structures are thoroughly explored, little attention was drawn toward the objective function. In most of the available CNNs in the MI area, the standard cross-entropy loss is usually performed as the objective function, which only ensures deep feature separability. Corresponding to the limitation of current objective functions, a new loss function with a combination of smoothed cross-entropy (with label smoothing) and center loss is proposed as the supervision signal for the model in the MI recognition task. Specifically, the smoothed cross-entropy is calculated by the entropy between the predicted labels and the one-hot hard labels regularized by a noise of uniform distribution. The center loss learns a deep feature center for each class and minimizes the distance between deep features and their corresponding centers. The proposed loss tries to optimize the model in two learning objectives, preventing overconfident predictions and increasing deep feature discriminative capacity (interclass separability and intraclass invariant), which guarantee the effectiveness of MI recognition models. We conduct extensive experiments on two well-known benchmarks (BCI competition IV-2a and IV-2b) to evaluate our method. The result indicates that the proposed approach achieves better performance than other SoA models on both datasets. The proposed learning scheme offers a more robust optimization for the CNN model in the MI classification task, simultaneously decreasing the risk of overfitting and increasing the discriminative power of deeply learned features. Frontiers Media S.A. 2021-10-22 /pmc/articles/PMC8570040/ /pubmed/34744622 http://dx.doi.org/10.3389/fnins.2021.760979 Text en Copyright © 2021 Huang, Zhou and Choi. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Huang, Xiuyu Zhou, Nan Choi, Kup-Sze A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title | A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title_full | A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title_fullStr | A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title_full_unstemmed | A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title_short | A Generalizable and Discriminative Learning Method for Deep EEG-Based Motor Imagery Classification |
title_sort | generalizable and discriminative learning method for deep eeg-based motor imagery classification |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8570040/ https://www.ncbi.nlm.nih.gov/pubmed/34744622 http://dx.doi.org/10.3389/fnins.2021.760979 |
work_keys_str_mv | AT huangxiuyu ageneralizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification AT zhounan ageneralizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification AT choikupsze ageneralizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification AT huangxiuyu generalizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification AT zhounan generalizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification AT choikupsze generalizableanddiscriminativelearningmethodfordeepeegbasedmotorimageryclassification |