Cargando…

Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron

Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge....

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, J. J., Hu, S. G., Zhan, X. T., Yu, Q., Liu, Z., Chen, T. P., Yin, Y., Hosaka, Sumio, Liu, Y.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6105732/
https://www.ncbi.nlm.nih.gov/pubmed/30135449
http://dx.doi.org/10.1038/s41598-018-30768-0
_version_ 1783349686627729408
author Wang, J. J.
Hu, S. G.
Zhan, X. T.
Yu, Q.
Liu, Z.
Chen, T. P.
Yin, Y.
Hosaka, Sumio
Liu, Y.
author_facet Wang, J. J.
Hu, S. G.
Zhan, X. T.
Yu, Q.
Liu, Z.
Chen, T. P.
Yin, Y.
Hosaka, Sumio
Liu, Y.
author_sort Wang, J. J.
collection PubMed
description Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge. Recently, phase change memristor neuron has been proposed to realize a human-brain level neural network operating at a high speed while consuming a small amount of power and having a high integration density. Although memristor neuron can be scaled down to nanometer, integration of 10(10)–10(11) neurons still faces many problems in circuit complexity, chip area, power consumption, etc. In this work, we propose a CMOS compatible HfO(2) memristor neuron that can be well integrated with silicon circuits. A hybrid Convolutional Neural Network (CNN) based on the HfO(2) memristor neuron is proposed and constructed. In the hybrid CNN, one memristive neuron can behave as multiple physical neurons based on the Time Division Multiplexing Access (TDMA) technique. Handwritten digit recognition is demonstrated in the hybrid CNN with a memristive neuron acting as 784 physical neurons. This work paves the way towards substantially shrinking the amount of neurons required in hardware and realization of more complex or even human cerebral cortex level memristive neural networks.
format Online
Article
Text
id pubmed-6105732
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-61057322018-08-28 Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron Wang, J. J. Hu, S. G. Zhan, X. T. Yu, Q. Liu, Z. Chen, T. P. Yin, Y. Hosaka, Sumio Liu, Y. Sci Rep Article Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 10(10)–10(11) neurons is still of great challenge. Recently, phase change memristor neuron has been proposed to realize a human-brain level neural network operating at a high speed while consuming a small amount of power and having a high integration density. Although memristor neuron can be scaled down to nanometer, integration of 10(10)–10(11) neurons still faces many problems in circuit complexity, chip area, power consumption, etc. In this work, we propose a CMOS compatible HfO(2) memristor neuron that can be well integrated with silicon circuits. A hybrid Convolutional Neural Network (CNN) based on the HfO(2) memristor neuron is proposed and constructed. In the hybrid CNN, one memristive neuron can behave as multiple physical neurons based on the Time Division Multiplexing Access (TDMA) technique. Handwritten digit recognition is demonstrated in the hybrid CNN with a memristive neuron acting as 784 physical neurons. This work paves the way towards substantially shrinking the amount of neurons required in hardware and realization of more complex or even human cerebral cortex level memristive neural networks. Nature Publishing Group UK 2018-08-22 /pmc/articles/PMC6105732/ /pubmed/30135449 http://dx.doi.org/10.1038/s41598-018-30768-0 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Wang, J. J.
Hu, S. G.
Zhan, X. T.
Yu, Q.
Liu, Z.
Chen, T. P.
Yin, Y.
Hosaka, Sumio
Liu, Y.
Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title_full Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title_fullStr Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title_full_unstemmed Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title_short Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO(2) Memristive Spiking-Neuron
title_sort handwritten-digit recognition by hybrid convolutional neural network based on hfo(2) memristive spiking-neuron
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6105732/
https://www.ncbi.nlm.nih.gov/pubmed/30135449
http://dx.doi.org/10.1038/s41598-018-30768-0
work_keys_str_mv AT wangjj handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT husg handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT zhanxt handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT yuq handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT liuz handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT chentp handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT yiny handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT hosakasumio handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron
AT liuy handwrittendigitrecognitionbyhybridconvolutionalneuralnetworkbasedonhfo2memristivespikingneuron