Cargando…
SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection
Detecting video-induced P3 is crucial to building the video target detection system based on the brain-computer interface. However, studies have shown that the brain response patterns corresponding to video-induced P3 are dynamic and determined by the interaction of multiple brain regions. This pape...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9201684/ https://www.ncbi.nlm.nih.gov/pubmed/35720707 http://dx.doi.org/10.3389/fnins.2022.913027 |
_version_ | 1784728368117186560 |
---|---|
author | Lu, Runnan Zeng, Ying Zhang, Rongkai Yan, Bin Tong, Li |
author_facet | Lu, Runnan Zeng, Ying Zhang, Rongkai Yan, Bin Tong, Li |
author_sort | Lu, Runnan |
collection | PubMed |
description | Detecting video-induced P3 is crucial to building the video target detection system based on the brain-computer interface. However, studies have shown that the brain response patterns corresponding to video-induced P3 are dynamic and determined by the interaction of multiple brain regions. This paper proposes a segmentation adaptive spatial-temporal graph convolutional network (SAST-GCN) for P3-based video target detection. To make full use of the dynamic characteristics of the P3 signal data, the data is segmented according to the processing stages of the video-induced P3, and the brain network connections are constructed correspondingly. Then, the spatial-temporal feature of EEG data is extracted by adaptive spatial-temporal graph convolution to discriminate the target and non-target in the video. Especially, a style-based recalibration module is added to select feature maps with higher contributions and increase the feature extraction ability of the network. The experimental results demonstrate the superiority of our proposed model over the baseline methods. Also, the ablation experiments indicate that the segmentation of data to construct the brain connection can effectively improve the recognition performance by reflecting the dynamic connection relationship between EEG channels more accurately. |
format | Online Article Text |
id | pubmed-9201684 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-92016842022-06-17 SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection Lu, Runnan Zeng, Ying Zhang, Rongkai Yan, Bin Tong, Li Front Neurosci Neuroscience Detecting video-induced P3 is crucial to building the video target detection system based on the brain-computer interface. However, studies have shown that the brain response patterns corresponding to video-induced P3 are dynamic and determined by the interaction of multiple brain regions. This paper proposes a segmentation adaptive spatial-temporal graph convolutional network (SAST-GCN) for P3-based video target detection. To make full use of the dynamic characteristics of the P3 signal data, the data is segmented according to the processing stages of the video-induced P3, and the brain network connections are constructed correspondingly. Then, the spatial-temporal feature of EEG data is extracted by adaptive spatial-temporal graph convolution to discriminate the target and non-target in the video. Especially, a style-based recalibration module is added to select feature maps with higher contributions and increase the feature extraction ability of the network. The experimental results demonstrate the superiority of our proposed model over the baseline methods. Also, the ablation experiments indicate that the segmentation of data to construct the brain connection can effectively improve the recognition performance by reflecting the dynamic connection relationship between EEG channels more accurately. Frontiers Media S.A. 2022-06-02 /pmc/articles/PMC9201684/ /pubmed/35720707 http://dx.doi.org/10.3389/fnins.2022.913027 Text en Copyright © 2022 Lu, Zeng, Zhang, Yan and Tong. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Lu, Runnan Zeng, Ying Zhang, Rongkai Yan, Bin Tong, Li SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title | SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title_full | SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title_fullStr | SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title_full_unstemmed | SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title_short | SAST-GCN: Segmentation Adaptive Spatial Temporal-Graph Convolutional Network for P3-Based Video Target Detection |
title_sort | sast-gcn: segmentation adaptive spatial temporal-graph convolutional network for p3-based video target detection |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9201684/ https://www.ncbi.nlm.nih.gov/pubmed/35720707 http://dx.doi.org/10.3389/fnins.2022.913027 |
work_keys_str_mv | AT lurunnan sastgcnsegmentationadaptivespatialtemporalgraphconvolutionalnetworkforp3basedvideotargetdetection AT zengying sastgcnsegmentationadaptivespatialtemporalgraphconvolutionalnetworkforp3basedvideotargetdetection AT zhangrongkai sastgcnsegmentationadaptivespatialtemporalgraphconvolutionalnetworkforp3basedvideotargetdetection AT yanbin sastgcnsegmentationadaptivespatialtemporalgraphconvolutionalnetworkforp3basedvideotargetdetection AT tongli sastgcnsegmentationadaptivespatialtemporalgraphconvolutionalnetworkforp3basedvideotargetdetection |