Cargando…

Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes

Motor imagery (MI) brain–computer interfaces (BCIs) have been used for a wide variety of applications due to their intuitive matching between the user’s intentions and the performance of tasks. Applying dry electroencephalography (EEG) electrodes to MI BCI applications can resolve many constraints a...

Descripción completa

Detalles Bibliográficos
Autores principales: Jeong, Ji-Hyeok, Choi, Jun-Hyuk, Kim, Keun-Tae, Lee, Song-Joo, Kim, Dong-Joo, Kim, Hyung-Min
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513081/
https://www.ncbi.nlm.nih.gov/pubmed/34640992
http://dx.doi.org/10.3390/s21196672
_version_ 1784583146979721216
author Jeong, Ji-Hyeok
Choi, Jun-Hyuk
Kim, Keun-Tae
Lee, Song-Joo
Kim, Dong-Joo
Kim, Hyung-Min
author_facet Jeong, Ji-Hyeok
Choi, Jun-Hyuk
Kim, Keun-Tae
Lee, Song-Joo
Kim, Dong-Joo
Kim, Hyung-Min
author_sort Jeong, Ji-Hyeok
collection PubMed
description Motor imagery (MI) brain–computer interfaces (BCIs) have been used for a wide variety of applications due to their intuitive matching between the user’s intentions and the performance of tasks. Applying dry electroencephalography (EEG) electrodes to MI BCI applications can resolve many constraints and achieve practicality. In this study, we propose a multi-domain convolutional neural networks (MD-CNN) model that learns subject-specific and electrode-dependent EEG features using a multi-domain structure to improve the classification accuracy of dry electrode MI BCIs. The proposed MD-CNN model is composed of learning layers for three domain representations (time, spatial, and phase). We first evaluated the proposed MD-CNN model using a public dataset to confirm 78.96% classification accuracy for multi-class classification (chance level accuracy: 30%). After that, 10 healthy subjects participated and performed three classes of MI tasks related to lower-limb movement (gait, sitting down, and resting) over two sessions (dry and wet electrodes). Consequently, the proposed MD-CNN model achieved the highest classification accuracy (dry: 58.44%; wet: 58.66%; chance level accuracy: 43.33%) with a three-class classifier and the lowest difference in accuracy between the two electrode types (0.22%, d = 0.0292) compared with the conventional classifiers (FBCSP, EEGNet, ShallowConvNet, and DeepConvNet) that used only a single domain. We expect that the proposed MD-CNN model could be applied for developing robust MI BCI systems with dry electrodes.
format Online
Article
Text
id pubmed-8513081
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-85130812021-10-14 Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes Jeong, Ji-Hyeok Choi, Jun-Hyuk Kim, Keun-Tae Lee, Song-Joo Kim, Dong-Joo Kim, Hyung-Min Sensors (Basel) Article Motor imagery (MI) brain–computer interfaces (BCIs) have been used for a wide variety of applications due to their intuitive matching between the user’s intentions and the performance of tasks. Applying dry electroencephalography (EEG) electrodes to MI BCI applications can resolve many constraints and achieve practicality. In this study, we propose a multi-domain convolutional neural networks (MD-CNN) model that learns subject-specific and electrode-dependent EEG features using a multi-domain structure to improve the classification accuracy of dry electrode MI BCIs. The proposed MD-CNN model is composed of learning layers for three domain representations (time, spatial, and phase). We first evaluated the proposed MD-CNN model using a public dataset to confirm 78.96% classification accuracy for multi-class classification (chance level accuracy: 30%). After that, 10 healthy subjects participated and performed three classes of MI tasks related to lower-limb movement (gait, sitting down, and resting) over two sessions (dry and wet electrodes). Consequently, the proposed MD-CNN model achieved the highest classification accuracy (dry: 58.44%; wet: 58.66%; chance level accuracy: 43.33%) with a three-class classifier and the lowest difference in accuracy between the two electrode types (0.22%, d = 0.0292) compared with the conventional classifiers (FBCSP, EEGNet, ShallowConvNet, and DeepConvNet) that used only a single domain. We expect that the proposed MD-CNN model could be applied for developing robust MI BCI systems with dry electrodes. MDPI 2021-10-07 /pmc/articles/PMC8513081/ /pubmed/34640992 http://dx.doi.org/10.3390/s21196672 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Jeong, Ji-Hyeok
Choi, Jun-Hyuk
Kim, Keun-Tae
Lee, Song-Joo
Kim, Dong-Joo
Kim, Hyung-Min
Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title_full Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title_fullStr Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title_full_unstemmed Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title_short Multi-Domain Convolutional Neural Networks for Lower-Limb Motor Imagery Using Dry vs. Wet Electrodes
title_sort multi-domain convolutional neural networks for lower-limb motor imagery using dry vs. wet electrodes
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513081/
https://www.ncbi.nlm.nih.gov/pubmed/34640992
http://dx.doi.org/10.3390/s21196672
work_keys_str_mv AT jeongjihyeok multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes
AT choijunhyuk multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes
AT kimkeuntae multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes
AT leesongjoo multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes
AT kimdongjoo multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes
AT kimhyungmin multidomainconvolutionalneuralnetworksforlowerlimbmotorimageryusingdryvswetelectrodes