Cargando…

Research and Verification of Convolutional Neural Network Lightweight in BCI

With the increasing of depth and complexity of the convolutional neural network, parameter dimensionality and volume of computing have greatly restricted its applications. Based on the SqueezeNet network structure, this study introduces a block convolution and uses channel shuffle between blocks to...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Shipu, Li, Runlong, Wang, Yunsheng, Liu, Yong, Hu, Wenwen, Wu, Yingjing, Zhang, Chenxi, Liu, Chang, Ma, Chao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7416271/
https://www.ncbi.nlm.nih.gov/pubmed/32802151
http://dx.doi.org/10.1155/2020/5916818
_version_ 1783569294141947904
author Xu, Shipu
Li, Runlong
Wang, Yunsheng
Liu, Yong
Hu, Wenwen
Wu, Yingjing
Zhang, Chenxi
Liu, Chang
Ma, Chao
author_facet Xu, Shipu
Li, Runlong
Wang, Yunsheng
Liu, Yong
Hu, Wenwen
Wu, Yingjing
Zhang, Chenxi
Liu, Chang
Ma, Chao
author_sort Xu, Shipu
collection PubMed
description With the increasing of depth and complexity of the convolutional neural network, parameter dimensionality and volume of computing have greatly restricted its applications. Based on the SqueezeNet network structure, this study introduces a block convolution and uses channel shuffle between blocks to alleviate the information jam. The method is aimed at reducing the dimensionality of parameters of in an original network structure and improving the efficiency of network operation. The verification performance of the ORL dataset shows that the classification accuracy and convergence efficiency are not reduced or even slightly improved when the network parameters are reduced, which supports the validity of block convolution in structure lightweight. Moreover, using a classic CIFAR-10 dataset, this network decreases parameter dimensionality while accelerating computational processing, with excellent convergence stability and efficiency when the network accuracy is only reduced by 1.3%.
format Online
Article
Text
id pubmed-7416271
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-74162712020-08-14 Research and Verification of Convolutional Neural Network Lightweight in BCI Xu, Shipu Li, Runlong Wang, Yunsheng Liu, Yong Hu, Wenwen Wu, Yingjing Zhang, Chenxi Liu, Chang Ma, Chao Comput Math Methods Med Research Article With the increasing of depth and complexity of the convolutional neural network, parameter dimensionality and volume of computing have greatly restricted its applications. Based on the SqueezeNet network structure, this study introduces a block convolution and uses channel shuffle between blocks to alleviate the information jam. The method is aimed at reducing the dimensionality of parameters of in an original network structure and improving the efficiency of network operation. The verification performance of the ORL dataset shows that the classification accuracy and convergence efficiency are not reduced or even slightly improved when the network parameters are reduced, which supports the validity of block convolution in structure lightweight. Moreover, using a classic CIFAR-10 dataset, this network decreases parameter dimensionality while accelerating computational processing, with excellent convergence stability and efficiency when the network accuracy is only reduced by 1.3%. Hindawi 2020-08-01 /pmc/articles/PMC7416271/ /pubmed/32802151 http://dx.doi.org/10.1155/2020/5916818 Text en Copyright © 2020 Shipu Xu et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Xu, Shipu
Li, Runlong
Wang, Yunsheng
Liu, Yong
Hu, Wenwen
Wu, Yingjing
Zhang, Chenxi
Liu, Chang
Ma, Chao
Research and Verification of Convolutional Neural Network Lightweight in BCI
title Research and Verification of Convolutional Neural Network Lightweight in BCI
title_full Research and Verification of Convolutional Neural Network Lightweight in BCI
title_fullStr Research and Verification of Convolutional Neural Network Lightweight in BCI
title_full_unstemmed Research and Verification of Convolutional Neural Network Lightweight in BCI
title_short Research and Verification of Convolutional Neural Network Lightweight in BCI
title_sort research and verification of convolutional neural network lightweight in bci
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7416271/
https://www.ncbi.nlm.nih.gov/pubmed/32802151
http://dx.doi.org/10.1155/2020/5916818
work_keys_str_mv AT xushipu researchandverificationofconvolutionalneuralnetworklightweightinbci
AT lirunlong researchandverificationofconvolutionalneuralnetworklightweightinbci
AT wangyunsheng researchandverificationofconvolutionalneuralnetworklightweightinbci
AT liuyong researchandverificationofconvolutionalneuralnetworklightweightinbci
AT huwenwen researchandverificationofconvolutionalneuralnetworklightweightinbci
AT wuyingjing researchandverificationofconvolutionalneuralnetworklightweightinbci
AT zhangchenxi researchandverificationofconvolutionalneuralnetworklightweightinbci
AT liuchang researchandverificationofconvolutionalneuralnetworklightweightinbci
AT machao researchandverificationofconvolutionalneuralnetworklightweightinbci