Cargando…
Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge....
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6105732/ https://www.ncbi.nlm.nih.gov/pubmed/30135449 http://dx.doi.org/10.1038/s41598-018-30768-0 |
_version_ | 1783349686627729408 |
---|---|
author | Wang, J. J. Hu, S. G. Zhan, X. T. Yu, Q. Liu, Z. Chen, T. P. Yin, Y. Hosaka, Sumio Liu, Y. |
author_facet | Wang, J. J. Hu, S. G. Zhan, X. T. Yu, Q. Liu, Z. Chen, T. P. Yin, Y. Hosaka, Sumio Liu, Y. |
author_sort | Wang, J. J. |
collection | PubMed |
description | Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge. Recently, phase change memristor neuron has been proposed to realize a human-brain level neural network operating at a high speed while consuming a small amount of power and having a high integration density. Although memristor neuron can be scaled down to nanometer, integration of 10(10)–10(11) neurons still faces many problems in circuit complexity, chip area, power consumption, etc. In this work, we propose a CMOS compatible HfO(2) memristor neuron that can be well integrated with silicon circuits. A hybrid Convolutional Neural Network (CNN) based on the HfO(2) memristor neuron is proposed and constructed. In the hybrid CNN, one memristive neuron can behave as multiple physical neurons based on the Time Division Multiplexing Access (TDMA) technique. Handwritten digit recognition is demonstrated in the hybrid CNN with a memristive neuron acting as 784 physical neurons. This work paves the way towards substantially shrinking the amount of neurons required in hardware and realization of more complex or even human cerebral cortex level memristive neural networks. |
format | Online Article Text |
id | pubmed-6105732 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-61057322018-08-28 Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron Wang, J. J. Hu, S. G. Zhan, X. T. Yu, Q. Liu, Z. Chen, T. P. Yin, Y. Hosaka, Sumio Liu, Y. Sci Rep Article Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge. Recently, phase change memristor neuron has been proposed to realize a human-brain level neural network operating at a high speed while consuming a small amount of power and having a high integration density. Although memristor neuron can be scaled down to nanometer, integration of 10(10)–10(11) neurons still faces many problems in circuit complexity, chip area, power consumption, etc. In this work, we propose a CMOS compatible HfO(2) memristor neuron that can be well integrated with silicon circuits. A hybrid Convolutional Neural Network (CNN) based on the HfO(2) memristor neuron is proposed and constructed. In the hybrid CNN, one memristive neuron can behave as multiple physical neurons based on the Time Division Multiplexing Access (TDMA) technique. Handwritten digit recognition is demonstrated in the hybrid CNN with a memristive neuron acting as 784 physical neurons. This work paves the way towards substantially shrinking the amount of neurons required in hardware and realization of more complex or even human cerebral cortex level memristive neural networks. Nature Publishing Group UK 2018-08-22 /pmc/articles/PMC6105732/ /pubmed/30135449 http://dx.doi.org/10.1038/s41598-018-30768-0 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Wang, J. J. Hu, S. G. Zhan, X. T. Yu, Q. Liu, Z. Chen, T. P. Yin, Y. Hosaka, Sumio Liu, Y. Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title | Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title_full | Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title_fullStr | Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title_full_unstemmed | Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title_short | Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron |
title_sort | handwritten-digit recognition by hybrid convolutional neural network based on hfo(2) memristive spiking-neuron |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6105732/ https://www.ncbi.nlm.nih.gov/pubmed/30135449 http://dx.doi.org/10.1038/s41598-018-30768-0 |
work_keys_str_mv | AT wangjj handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT husg handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT zhanxt handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT yuq handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT liuz handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT chentp handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT yiny handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT hosakasumio handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron AT liuy handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron |