Cargando…
Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG
Classification of electroencephalography (EEG) signals corresponding to imagined speech production is important for the development of a direct-speech brain–computer interface (DS-BCI). Deep learning (DL) has been utilized with great success across several domains. However, it remains an open questi...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7472624/ https://www.ncbi.nlm.nih.gov/pubmed/32824559 http://dx.doi.org/10.3390/s20164629 |
_version_ | 1783579022842658816 |
---|---|
author | Cooney, Ciaran Korik, Attila Folli, Raffaella Coyle, Damien |
author_facet | Cooney, Ciaran Korik, Attila Folli, Raffaella Coyle, Damien |
author_sort | Cooney, Ciaran |
collection | PubMed |
description | Classification of electroencephalography (EEG) signals corresponding to imagined speech production is important for the development of a direct-speech brain–computer interface (DS-BCI). Deep learning (DL) has been utilized with great success across several domains. However, it remains an open question whether DL methods provide significant advances over traditional machine learning (ML) approaches for classification of imagined speech. Furthermore, hyperparameter (HP) optimization has been neglected in DL-EEG studies, resulting in the significance of its effects remaining uncertain. In this study, we aim to improve classification of imagined speech EEG by employing DL methods while also statistically evaluating the impact of HP optimization on classifier performance. We trained three distinct convolutional neural networks (CNN) on imagined speech EEG using a nested cross-validation approach to HP optimization. Each of the CNNs evaluated was designed specifically for EEG decoding. An imagined speech EEG dataset consisting of both words and vowels facilitated training on both sets independently. CNN results were compared with three benchmark ML methods: Support Vector Machine, Random Forest and regularized Linear Discriminant Analysis. Intra- and inter-subject methods of HP optimization were tested and the effects of HPs statistically analyzed. Accuracies obtained by the CNNs were significantly greater than the benchmark methods when trained on both datasets (words: 24.97%, p < 1 × 10(–7), chance: 16.67%; vowels: 30.00%, p < 1 × 10(–7), chance: 20%). The effects of varying HP values, and interactions between HPs and the CNNs were both statistically significant. The results of HP optimization demonstrate how critical it is for training CNNs to decode imagined speech. |
format | Online Article Text |
id | pubmed-7472624 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-74726242020-09-17 Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG Cooney, Ciaran Korik, Attila Folli, Raffaella Coyle, Damien Sensors (Basel) Article Classification of electroencephalography (EEG) signals corresponding to imagined speech production is important for the development of a direct-speech brain–computer interface (DS-BCI). Deep learning (DL) has been utilized with great success across several domains. However, it remains an open question whether DL methods provide significant advances over traditional machine learning (ML) approaches for classification of imagined speech. Furthermore, hyperparameter (HP) optimization has been neglected in DL-EEG studies, resulting in the significance of its effects remaining uncertain. In this study, we aim to improve classification of imagined speech EEG by employing DL methods while also statistically evaluating the impact of HP optimization on classifier performance. We trained three distinct convolutional neural networks (CNN) on imagined speech EEG using a nested cross-validation approach to HP optimization. Each of the CNNs evaluated was designed specifically for EEG decoding. An imagined speech EEG dataset consisting of both words and vowels facilitated training on both sets independently. CNN results were compared with three benchmark ML methods: Support Vector Machine, Random Forest and regularized Linear Discriminant Analysis. Intra- and inter-subject methods of HP optimization were tested and the effects of HPs statistically analyzed. Accuracies obtained by the CNNs were significantly greater than the benchmark methods when trained on both datasets (words: 24.97%, p < 1 × 10(–7), chance: 16.67%; vowels: 30.00%, p < 1 × 10(–7), chance: 20%). The effects of varying HP values, and interactions between HPs and the CNNs were both statistically significant. The results of HP optimization demonstrate how critical it is for training CNNs to decode imagined speech. MDPI 2020-08-17 /pmc/articles/PMC7472624/ /pubmed/32824559 http://dx.doi.org/10.3390/s20164629 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Cooney, Ciaran Korik, Attila Folli, Raffaella Coyle, Damien Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title | Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title_full | Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title_fullStr | Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title_full_unstemmed | Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title_short | Evaluation of Hyperparameter Optimization in Machine and Deep Learning Methods for Decoding Imagined Speech EEG |
title_sort | evaluation of hyperparameter optimization in machine and deep learning methods for decoding imagined speech eeg |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7472624/ https://www.ncbi.nlm.nih.gov/pubmed/32824559 http://dx.doi.org/10.3390/s20164629 |
work_keys_str_mv | AT cooneyciaran evaluationofhyperparameteroptimizationinmachineanddeeplearningmethodsfordecodingimaginedspeecheeg AT korikattila evaluationofhyperparameteroptimizationinmachineanddeeplearningmethodsfordecodingimaginedspeecheeg AT folliraffaella evaluationofhyperparameteroptimizationinmachineanddeeplearningmethodsfordecodingimaginedspeecheeg AT coyledamien evaluationofhyperparameteroptimizationinmachineanddeeplearningmethodsfordecodingimaginedspeecheeg |