Cargando…
Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel d...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8873790/ https://www.ncbi.nlm.nih.gov/pubmed/35223807 http://dx.doi.org/10.3389/fbioe.2021.706229 |
_version_ | 1784657540654563328 |
---|---|
author | Hou, Yimin Jia, Shuyue Lun, Xiangmin Zhang, Shu Chen, Tao Wang, Fang Lv, Jinglei |
author_facet | Hou, Yimin Jia, Shuyue Lun, Xiangmin Zhang, Shu Chen, Tao Wang, Fang Lv, Jinglei |
author_sort | Hou, Yimin |
collection | PubMed |
description | Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel deep learning approach designed toward both remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional long short-term memory (BiLSTM) with the attention mechanism is employed, and the graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. Particularly, this method is trained and tested on the short EEG recording with only 0.4 s in length, and the result has shown effective and efficient prediction based on individual and groupwise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw and almost-instant EEG signals, which paves the road to translate the EEG-based MI recognition to practical BCI systems. |
format | Online Article Text |
id | pubmed-8873790 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-88737902022-02-26 Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition Hou, Yimin Jia, Shuyue Lun, Xiangmin Zhang, Shu Chen, Tao Wang, Fang Lv, Jinglei Front Bioeng Biotechnol Bioengineering and Biotechnology Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel deep learning approach designed toward both remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional long short-term memory (BiLSTM) with the attention mechanism is employed, and the graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. Particularly, this method is trained and tested on the short EEG recording with only 0.4 s in length, and the result has shown effective and efficient prediction based on individual and groupwise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw and almost-instant EEG signals, which paves the road to translate the EEG-based MI recognition to practical BCI systems. Frontiers Media S.A. 2022-02-11 /pmc/articles/PMC8873790/ /pubmed/35223807 http://dx.doi.org/10.3389/fbioe.2021.706229 Text en Copyright © 2022 Hou, Jia, Lun, Zhang, Chen, Wang and Lv. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Bioengineering and Biotechnology Hou, Yimin Jia, Shuyue Lun, Xiangmin Zhang, Shu Chen, Tao Wang, Fang Lv, Jinglei Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title | Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title_full | Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title_fullStr | Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title_full_unstemmed | Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title_short | Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition |
title_sort | deep feature mining via the attention-based bidirectional long short term memory graph convolutional neural network for human motor imagery recognition |
topic | Bioengineering and Biotechnology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8873790/ https://www.ncbi.nlm.nih.gov/pubmed/35223807 http://dx.doi.org/10.3389/fbioe.2021.706229 |
work_keys_str_mv | AT houyimin deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT jiashuyue deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT lunxiangmin deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT zhangshu deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT chentao deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT wangfang deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition AT lvjinglei deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition |