Cargando…

Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling

Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalizatio...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shui-Hua, Tang, Chaosheng, Sun, Junding, Yang, Jingyuan, Huang, Chenxi, Phillips, Preetha, Zhang, Yu-Dong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6236001/
https://www.ncbi.nlm.nih.gov/pubmed/30467462
http://dx.doi.org/10.3389/fnins.2018.00818
_version_ 1783370950974111744
author Wang, Shui-Hua
Tang, Chaosheng
Sun, Junding
Yang, Jingyuan
Huang, Chenxi
Phillips, Preetha
Zhang, Yu-Dong
author_facet Wang, Shui-Hua
Tang, Chaosheng
Sun, Junding
Yang, Jingyuan
Huang, Chenxi
Phillips, Preetha
Zhang, Yu-Dong
author_sort Wang, Shui-Hua
collection PubMed
description Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalization, dropout, and stochastic pooling. The output of the stochastic pooling was obtained via sampling from a multinomial distribution formed from the activations of each pooling region. In addition, we used data augmentation method to enhance the training set. In total 10 runs were implemented with the hold-out randomly set for each run. Results: The results showed that our 14-layer CNN secured a sensitivity of 98.77 ± 0.35%, a specificity of 98.76 ± 0.58%, and an accuracy of 98.77 ± 0.39%. Conclusion: Our results were compared with CNN using maximum pooling and average pooling. The comparison shows stochastic pooling gives better performance than other two pooling methods. Furthermore, we compared our proposed method with six state-of-the-art approaches, including five traditional artificial intelligence methods and one deep learning method. The comparison shows our method is superior to all other six state-of-the-art approaches.
format Online
Article
Text
id pubmed-6236001
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-62360012018-11-22 Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling Wang, Shui-Hua Tang, Chaosheng Sun, Junding Yang, Jingyuan Huang, Chenxi Phillips, Preetha Zhang, Yu-Dong Front Neurosci Neuroscience Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalization, dropout, and stochastic pooling. The output of the stochastic pooling was obtained via sampling from a multinomial distribution formed from the activations of each pooling region. In addition, we used data augmentation method to enhance the training set. In total 10 runs were implemented with the hold-out randomly set for each run. Results: The results showed that our 14-layer CNN secured a sensitivity of 98.77 ± 0.35%, a specificity of 98.76 ± 0.58%, and an accuracy of 98.77 ± 0.39%. Conclusion: Our results were compared with CNN using maximum pooling and average pooling. The comparison shows stochastic pooling gives better performance than other two pooling methods. Furthermore, we compared our proposed method with six state-of-the-art approaches, including five traditional artificial intelligence methods and one deep learning method. The comparison shows our method is superior to all other six state-of-the-art approaches. Frontiers Media S.A. 2018-11-08 /pmc/articles/PMC6236001/ /pubmed/30467462 http://dx.doi.org/10.3389/fnins.2018.00818 Text en Copyright © 2018 Wang, Tang, Sun, Yang, Huang, Phillips and Zhang. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Wang, Shui-Hua
Tang, Chaosheng
Sun, Junding
Yang, Jingyuan
Huang, Chenxi
Phillips, Preetha
Zhang, Yu-Dong
Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title_full Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title_fullStr Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title_full_unstemmed Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title_short Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
title_sort multiple sclerosis identification by 14-layer convolutional neural network with batch normalization, dropout, and stochastic pooling
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6236001/
https://www.ncbi.nlm.nih.gov/pubmed/30467462
http://dx.doi.org/10.3389/fnins.2018.00818
work_keys_str_mv AT wangshuihua multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT tangchaosheng multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT sunjunding multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT yangjingyuan multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT huangchenxi multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT phillipspreetha multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling
AT zhangyudong multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling