Cargando…

Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network

Brain decoding is to predict the external stimulus information from the collected brain response activities, and visual information is one of the most important sources of external stimulus information. Decoding functional magnetic resonance imaging (fMRI) based on visual stimulation is helpful in u...

Descripción completa

Detalles Bibliográficos
Autores principales: Meng, Lu, Ge, Kang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9599823/
https://www.ncbi.nlm.nih.gov/pubmed/36291327
http://dx.doi.org/10.3390/brainsci12101394
_version_ 1784816687799861248
author Meng, Lu
Ge, Kang
author_facet Meng, Lu
Ge, Kang
author_sort Meng, Lu
collection PubMed
description Brain decoding is to predict the external stimulus information from the collected brain response activities, and visual information is one of the most important sources of external stimulus information. Decoding functional magnetic resonance imaging (fMRI) based on visual stimulation is helpful in understanding the working mechanism of the brain visual function regions. Traditional brain decoding algorithms cannot accurately extract stimuli features from fMRI. To address these shortcomings, this paper proposed a brain decoding algorithm based on a graph convolution network (GCN). Firstly, 11 regions of interest (ROI) were selected according to the human brain visual function regions, which can avoid the noise interference of the non-visual regions of the human brain; then, a deep three-dimensional convolution neural network was specially designed to extract the features of these 11 regions; next, the GCN was used to extract the functional correlation features between the different human brain visual regions. Furthermore, to avoid the problem of gradient disappearance when there were too many layers of graph convolutional neural network, the residual connections were adopted in our algorithm, which helped to integrate different levels of features in order to improve the accuracy of the proposed GCN. The proposed algorithm was tested on the public dataset, and the recognition accuracy reached 98.67%. Compared with the other state-of-the-art algorithms, the proposed algorithm performed the best.
format Online
Article
Text
id pubmed-9599823
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95998232022-10-27 Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network Meng, Lu Ge, Kang Brain Sci Article Brain decoding is to predict the external stimulus information from the collected brain response activities, and visual information is one of the most important sources of external stimulus information. Decoding functional magnetic resonance imaging (fMRI) based on visual stimulation is helpful in understanding the working mechanism of the brain visual function regions. Traditional brain decoding algorithms cannot accurately extract stimuli features from fMRI. To address these shortcomings, this paper proposed a brain decoding algorithm based on a graph convolution network (GCN). Firstly, 11 regions of interest (ROI) were selected according to the human brain visual function regions, which can avoid the noise interference of the non-visual regions of the human brain; then, a deep three-dimensional convolution neural network was specially designed to extract the features of these 11 regions; next, the GCN was used to extract the functional correlation features between the different human brain visual regions. Furthermore, to avoid the problem of gradient disappearance when there were too many layers of graph convolutional neural network, the residual connections were adopted in our algorithm, which helped to integrate different levels of features in order to improve the accuracy of the proposed GCN. The proposed algorithm was tested on the public dataset, and the recognition accuracy reached 98.67%. Compared with the other state-of-the-art algorithms, the proposed algorithm performed the best. MDPI 2022-10-15 /pmc/articles/PMC9599823/ /pubmed/36291327 http://dx.doi.org/10.3390/brainsci12101394 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Meng, Lu
Ge, Kang
Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title_full Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title_fullStr Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title_full_unstemmed Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title_short Decoding Visual fMRI Stimuli from Human Brain Based on Graph Convolutional Neural Network
title_sort decoding visual fmri stimuli from human brain based on graph convolutional neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9599823/
https://www.ncbi.nlm.nih.gov/pubmed/36291327
http://dx.doi.org/10.3390/brainsci12101394
work_keys_str_mv AT menglu decodingvisualfmristimulifromhumanbrainbasedongraphconvolutionalneuralnetwork
AT gekang decodingvisualfmristimulifromhumanbrainbasedongraphconvolutionalneuralnetwork