Cargando…
Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling
Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalizatio...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6236001/ https://www.ncbi.nlm.nih.gov/pubmed/30467462 http://dx.doi.org/10.3389/fnins.2018.00818 |
_version_ | 1783370950974111744 |
---|---|
author | Wang, Shui-Hua Tang, Chaosheng Sun, Junding Yang, Jingyuan Huang, Chenxi Phillips, Preetha Zhang, Yu-Dong |
author_facet | Wang, Shui-Hua Tang, Chaosheng Sun, Junding Yang, Jingyuan Huang, Chenxi Phillips, Preetha Zhang, Yu-Dong |
author_sort | Wang, Shui-Hua |
collection | PubMed |
description | Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalization, dropout, and stochastic pooling. The output of the stochastic pooling was obtained via sampling from a multinomial distribution formed from the activations of each pooling region. In addition, we used data augmentation method to enhance the training set. In total 10 runs were implemented with the hold-out randomly set for each run. Results: The results showed that our 14-layer CNN secured a sensitivity of 98.77 ± 0.35%, a specificity of 98.76 ± 0.58%, and an accuracy of 98.77 ± 0.39%. Conclusion: Our results were compared with CNN using maximum pooling and average pooling. The comparison shows stochastic pooling gives better performance than other two pooling methods. Furthermore, we compared our proposed method with six state-of-the-art approaches, including five traditional artificial intelligence methods and one deep learning method. The comparison shows our method is superior to all other six state-of-the-art approaches. |
format | Online Article Text |
id | pubmed-6236001 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-62360012018-11-22 Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling Wang, Shui-Hua Tang, Chaosheng Sun, Junding Yang, Jingyuan Huang, Chenxi Phillips, Preetha Zhang, Yu-Dong Front Neurosci Neuroscience Aim: Multiple sclerosis is a severe brain and/or spinal cord disease. It may lead to a wide range of symptoms. Hence, the early diagnosis and treatment is quite important. Method: This study proposed a 14-layer convolutional neural network, combined with three advanced techniques: batch normalization, dropout, and stochastic pooling. The output of the stochastic pooling was obtained via sampling from a multinomial distribution formed from the activations of each pooling region. In addition, we used data augmentation method to enhance the training set. In total 10 runs were implemented with the hold-out randomly set for each run. Results: The results showed that our 14-layer CNN secured a sensitivity of 98.77 ± 0.35%, a specificity of 98.76 ± 0.58%, and an accuracy of 98.77 ± 0.39%. Conclusion: Our results were compared with CNN using maximum pooling and average pooling. The comparison shows stochastic pooling gives better performance than other two pooling methods. Furthermore, we compared our proposed method with six state-of-the-art approaches, including five traditional artificial intelligence methods and one deep learning method. The comparison shows our method is superior to all other six state-of-the-art approaches. Frontiers Media S.A. 2018-11-08 /pmc/articles/PMC6236001/ /pubmed/30467462 http://dx.doi.org/10.3389/fnins.2018.00818 Text en Copyright © 2018 Wang, Tang, Sun, Yang, Huang, Phillips and Zhang. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Wang, Shui-Hua Tang, Chaosheng Sun, Junding Yang, Jingyuan Huang, Chenxi Phillips, Preetha Zhang, Yu-Dong Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title | Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title_full | Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title_fullStr | Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title_full_unstemmed | Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title_short | Multiple Sclerosis Identification by 14-Layer Convolutional Neural Network With Batch Normalization, Dropout, and Stochastic Pooling |
title_sort | multiple sclerosis identification by 14-layer convolutional neural network with batch normalization, dropout, and stochastic pooling |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6236001/ https://www.ncbi.nlm.nih.gov/pubmed/30467462 http://dx.doi.org/10.3389/fnins.2018.00818 |
work_keys_str_mv | AT wangshuihua multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT tangchaosheng multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT sunjunding multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT yangjingyuan multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT huangchenxi multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT phillipspreetha multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling AT zhangyudong multiplesclerosisidentificationby14layerconvolutionalneuralnetworkwithbatchnormalizationdropoutandstochasticpooling |