Cargando…

EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation

The mental workload (MWL) of different occupational groups' workers is the main and direct factor of unsafe behavior, which may cause serious accidents. One of the new and useful technologies to estimate MWL is the Brain computer interface (BCI) based on EEG signals, which is regarded as the go...

Descripción completa

Detalles Bibliográficos
Autores principales: Fan, Chaojie, Hu, Jin, Huang, Shufang, Peng, Yong, Kwong, Sam
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9100931/
https://www.ncbi.nlm.nih.gov/pubmed/35573313
http://dx.doi.org/10.3389/fnins.2022.869522
_version_ 1784706962103992320
author Fan, Chaojie
Hu, Jin
Huang, Shufang
Peng, Yong
Kwong, Sam
author_facet Fan, Chaojie
Hu, Jin
Huang, Shufang
Peng, Yong
Kwong, Sam
author_sort Fan, Chaojie
collection PubMed
description The mental workload (MWL) of different occupational groups' workers is the main and direct factor of unsafe behavior, which may cause serious accidents. One of the new and useful technologies to estimate MWL is the Brain computer interface (BCI) based on EEG signals, which is regarded as the gold standard of cognitive status. However, estimation systems involving handcrafted EEG features are time-consuming and unsuitable to apply in real-time. The purpose of this study was to propose an end-to-end BCI framework for MWL estimation. First, a new automated data preprocessing method was proposed to remove the artifact without human interference. Then a new neural network structure named EEG-TNet was designed to extract both the temporal and frequency information from the original EEG. Furthermore, two types of experiments and ablation studies were performed to prove the effectiveness of this model. In the subject-dependent experiment, the estimation accuracy of dual-task estimation (No task vs. TASK) and triple-task estimation (Lo vs. Mi vs. Hi) reached 99.82 and 99.21%, respectively. In contrast, the accuracy of different tasks reached 82.78 and 66.83% in subject-independent experiments. Additionally, the ablation studies proved that preprocessing method and network structure had significant contributions to estimation MWL. The proposed method is convenient without any human intervention and outperforms other related studies, which becomes an effective way to reduce human factor risks.
format Online
Article
Text
id pubmed-9100931
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-91009312022-05-14 EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation Fan, Chaojie Hu, Jin Huang, Shufang Peng, Yong Kwong, Sam Front Neurosci Neuroscience The mental workload (MWL) of different occupational groups' workers is the main and direct factor of unsafe behavior, which may cause serious accidents. One of the new and useful technologies to estimate MWL is the Brain computer interface (BCI) based on EEG signals, which is regarded as the gold standard of cognitive status. However, estimation systems involving handcrafted EEG features are time-consuming and unsuitable to apply in real-time. The purpose of this study was to propose an end-to-end BCI framework for MWL estimation. First, a new automated data preprocessing method was proposed to remove the artifact without human interference. Then a new neural network structure named EEG-TNet was designed to extract both the temporal and frequency information from the original EEG. Furthermore, two types of experiments and ablation studies were performed to prove the effectiveness of this model. In the subject-dependent experiment, the estimation accuracy of dual-task estimation (No task vs. TASK) and triple-task estimation (Lo vs. Mi vs. Hi) reached 99.82 and 99.21%, respectively. In contrast, the accuracy of different tasks reached 82.78 and 66.83% in subject-independent experiments. Additionally, the ablation studies proved that preprocessing method and network structure had significant contributions to estimation MWL. The proposed method is convenient without any human intervention and outperforms other related studies, which becomes an effective way to reduce human factor risks. Frontiers Media S.A. 2022-04-25 /pmc/articles/PMC9100931/ /pubmed/35573313 http://dx.doi.org/10.3389/fnins.2022.869522 Text en Copyright © 2022 Fan, Hu, Huang, Peng and Kwong. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Fan, Chaojie
Hu, Jin
Huang, Shufang
Peng, Yong
Kwong, Sam
EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title_full EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title_fullStr EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title_full_unstemmed EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title_short EEG-TNet: An End-To-End Brain Computer Interface Framework for Mental Workload Estimation
title_sort eeg-tnet: an end-to-end brain computer interface framework for mental workload estimation
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9100931/
https://www.ncbi.nlm.nih.gov/pubmed/35573313
http://dx.doi.org/10.3389/fnins.2022.869522
work_keys_str_mv AT fanchaojie eegtnetanendtoendbraincomputerinterfaceframeworkformentalworkloadestimation
AT hujin eegtnetanendtoendbraincomputerinterfaceframeworkformentalworkloadestimation
AT huangshufang eegtnetanendtoendbraincomputerinterfaceframeworkformentalworkloadestimation
AT pengyong eegtnetanendtoendbraincomputerinterfaceframeworkformentalworkloadestimation
AT kwongsam eegtnetanendtoendbraincomputerinterfaceframeworkformentalworkloadestimation