Cargando…

Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition

Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel d...

Descripción completa

Detalles Bibliográficos
Autores principales: Hou, Yimin, Jia, Shuyue, Lun, Xiangmin, Zhang, Shu, Chen, Tao, Wang, Fang, Lv, Jinglei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8873790/
https://www.ncbi.nlm.nih.gov/pubmed/35223807
http://dx.doi.org/10.3389/fbioe.2021.706229
_version_ 1784657540654563328
author Hou, Yimin
Jia, Shuyue
Lun, Xiangmin
Zhang, Shu
Chen, Tao
Wang, Fang
Lv, Jinglei
author_facet Hou, Yimin
Jia, Shuyue
Lun, Xiangmin
Zhang, Shu
Chen, Tao
Wang, Fang
Lv, Jinglei
author_sort Hou, Yimin
collection PubMed
description Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel deep learning approach designed toward both remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional long short-term memory (BiLSTM) with the attention mechanism is employed, and the graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. Particularly, this method is trained and tested on the short EEG recording with only 0.4 s in length, and the result has shown effective and efficient prediction based on individual and groupwise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw and almost-instant EEG signals, which paves the road to translate the EEG-based MI recognition to practical BCI systems.
format Online
Article
Text
id pubmed-8873790
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-88737902022-02-26 Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition Hou, Yimin Jia, Shuyue Lun, Xiangmin Zhang, Shu Chen, Tao Wang, Fang Lv, Jinglei Front Bioeng Biotechnol Bioengineering and Biotechnology Recognition accuracy and response time are both critically essential ahead of building the practical electroencephalography (EEG)-based brain–computer interface (BCI). However, recent approaches have compromised either the classification accuracy or the responding time. This paper presents a novel deep learning approach designed toward both remarkably accurate and responsive motor imagery (MI) recognition based on scalp EEG. Bidirectional long short-term memory (BiLSTM) with the attention mechanism is employed, and the graph convolutional neural network (GCN) promotes the decoding performance by cooperating with the topological structure of features, which are estimated from the overall data. Particularly, this method is trained and tested on the short EEG recording with only 0.4 s in length, and the result has shown effective and efficient prediction based on individual and groupwise training, with 98.81% and 94.64% accuracy, respectively, which outperformed all the state-of-the-art studies. The introduced deep feature mining approach can precisely recognize human motion intents from raw and almost-instant EEG signals, which paves the road to translate the EEG-based MI recognition to practical BCI systems. Frontiers Media S.A. 2022-02-11 /pmc/articles/PMC8873790/ /pubmed/35223807 http://dx.doi.org/10.3389/fbioe.2021.706229 Text en Copyright © 2022 Hou, Jia, Lun, Zhang, Chen, Wang and Lv. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Bioengineering and Biotechnology
Hou, Yimin
Jia, Shuyue
Lun, Xiangmin
Zhang, Shu
Chen, Tao
Wang, Fang
Lv, Jinglei
Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title_full Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title_fullStr Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title_full_unstemmed Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title_short Deep Feature Mining via the Attention-Based Bidirectional Long Short Term Memory Graph Convolutional Neural Network for Human Motor Imagery Recognition
title_sort deep feature mining via the attention-based bidirectional long short term memory graph convolutional neural network for human motor imagery recognition
topic Bioengineering and Biotechnology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8873790/
https://www.ncbi.nlm.nih.gov/pubmed/35223807
http://dx.doi.org/10.3389/fbioe.2021.706229
work_keys_str_mv AT houyimin deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT jiashuyue deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT lunxiangmin deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT zhangshu deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT chentao deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT wangfang deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition
AT lvjinglei deepfeatureminingviatheattentionbasedbidirectionallongshorttermmemorygraphconvolutionalneuralnetworkforhumanmotorimageryrecognition