Cargando…

Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics

A crucial point in neuroscience is how to correctly decode cognitive information from brain dynamics for motion control and neural rehabilitation. However, due to the instability and high dimensions of electroencephalogram (EEG) recordings, it is difficult to directly obtain information from origina...

Descripción completa

Detalles Bibliográficos
Autores principales: Yu, Haitao, Zhao, Quanfa, Li, Shanshan, Li, Kai, Liu, Chen, Wang, Jiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8961731/
https://www.ncbi.nlm.nih.gov/pubmed/35360527
http://dx.doi.org/10.3389/fncom.2022.852281
_version_ 1784677659711635456
author Yu, Haitao
Zhao, Quanfa
Li, Shanshan
Li, Kai
Liu, Chen
Wang, Jiang
author_facet Yu, Haitao
Zhao, Quanfa
Li, Shanshan
Li, Kai
Liu, Chen
Wang, Jiang
author_sort Yu, Haitao
collection PubMed
description A crucial point in neuroscience is how to correctly decode cognitive information from brain dynamics for motion control and neural rehabilitation. However, due to the instability and high dimensions of electroencephalogram (EEG) recordings, it is difficult to directly obtain information from original data. Thus, in this work, we design visual experiments and propose a novel decoding method based on the neural manifold of cortical activity to find critical visual information. First, we studied four major frequency bands divided from EEG and found that the responses of the EEG alpha band (8–15 Hz) in the frontal and occipital lobes to visual stimuli occupy a prominent place. Besides, the essential features of EEG data in the alpha band are further mined via two manifold learning methods. We connect temporally consecutive brain states in the t distribution random adjacency embedded (t-SNE) map on the trial-by-trial level and find the brain state dynamics to form a cyclic manifold, with the different tasks forming distinct loops. Meanwhile, it is proved that the latent factors of brain activities estimated by t-SNE can be used for more accurate decoding and the stable neural manifold is found. Taking the latent factors of the manifold as independent inputs, a fuzzy system-based Takagi-Sugeno-Kang model is established and further trained to identify visual EEG signals. The combination of t-SNE and fuzzy learning can highly improve the accuracy of visual cognitive decoding to 81.98%. Moreover, by optimizing the features, it is found that the combination of the frontal lobe, the parietal lobe, and the occipital lobe is the most effective factor for visual decoding with 83.05% accuracy. This work provides a potential tool for decoding visual EEG signals with the help of low-dimensional manifold dynamics, especially contributing to the brain–computer interface (BCI) control, brain function research, and neural rehabilitation.
format Online
Article
Text
id pubmed-8961731
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-89617312022-03-30 Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics Yu, Haitao Zhao, Quanfa Li, Shanshan Li, Kai Liu, Chen Wang, Jiang Front Comput Neurosci Neuroscience A crucial point in neuroscience is how to correctly decode cognitive information from brain dynamics for motion control and neural rehabilitation. However, due to the instability and high dimensions of electroencephalogram (EEG) recordings, it is difficult to directly obtain information from original data. Thus, in this work, we design visual experiments and propose a novel decoding method based on the neural manifold of cortical activity to find critical visual information. First, we studied four major frequency bands divided from EEG and found that the responses of the EEG alpha band (8–15 Hz) in the frontal and occipital lobes to visual stimuli occupy a prominent place. Besides, the essential features of EEG data in the alpha band are further mined via two manifold learning methods. We connect temporally consecutive brain states in the t distribution random adjacency embedded (t-SNE) map on the trial-by-trial level and find the brain state dynamics to form a cyclic manifold, with the different tasks forming distinct loops. Meanwhile, it is proved that the latent factors of brain activities estimated by t-SNE can be used for more accurate decoding and the stable neural manifold is found. Taking the latent factors of the manifold as independent inputs, a fuzzy system-based Takagi-Sugeno-Kang model is established and further trained to identify visual EEG signals. The combination of t-SNE and fuzzy learning can highly improve the accuracy of visual cognitive decoding to 81.98%. Moreover, by optimizing the features, it is found that the combination of the frontal lobe, the parietal lobe, and the occipital lobe is the most effective factor for visual decoding with 83.05% accuracy. This work provides a potential tool for decoding visual EEG signals with the help of low-dimensional manifold dynamics, especially contributing to the brain–computer interface (BCI) control, brain function research, and neural rehabilitation. Frontiers Media S.A. 2022-03-11 /pmc/articles/PMC8961731/ /pubmed/35360527 http://dx.doi.org/10.3389/fncom.2022.852281 Text en Copyright © 2022 Yu, Zhao, Li, Li, Liu and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Yu, Haitao
Zhao, Quanfa
Li, Shanshan
Li, Kai
Liu, Chen
Wang, Jiang
Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title_full Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title_fullStr Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title_full_unstemmed Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title_short Decoding Digital Visual Stimulation From Neural Manifold With Fuzzy Leaning on Cortical Oscillatory Dynamics
title_sort decoding digital visual stimulation from neural manifold with fuzzy leaning on cortical oscillatory dynamics
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8961731/
https://www.ncbi.nlm.nih.gov/pubmed/35360527
http://dx.doi.org/10.3389/fncom.2022.852281
work_keys_str_mv AT yuhaitao decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics
AT zhaoquanfa decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics
AT lishanshan decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics
AT likai decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics
AT liuchen decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics
AT wangjiang decodingdigitalvisualstimulationfromneuralmanifoldwithfuzzyleaningoncorticaloscillatorydynamics