Cargando…

Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification

In the biological neural network, the learning process is achieved through massively parallel synaptic connections between neurons that can be adjusted in an analog manner. Recent developments in emerging synaptic devices and their networks can emulate the functionality of a biological neural networ...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Sungho, Choi, Bongsik, Yoon, Jinsu, Lee, Yongwoo, Kim, Hee-Dong, Kang, Min-Ho, Choi, Sung-Jin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6690903/
https://www.ncbi.nlm.nih.gov/pubmed/31406242
http://dx.doi.org/10.1038/s41598-019-48048-w
_version_ 1783443251497271296
author Kim, Sungho
Choi, Bongsik
Yoon, Jinsu
Lee, Yongwoo
Kim, Hee-Dong
Kang, Min-Ho
Choi, Sung-Jin
author_facet Kim, Sungho
Choi, Bongsik
Yoon, Jinsu
Lee, Yongwoo
Kim, Hee-Dong
Kang, Min-Ho
Choi, Sung-Jin
author_sort Kim, Sungho
collection PubMed
description In the biological neural network, the learning process is achieved through massively parallel synaptic connections between neurons that can be adjusted in an analog manner. Recent developments in emerging synaptic devices and their networks can emulate the functionality of a biological neural network, which will be the fundamental building block for a neuromorphic computing architecture. However, on-chip implementation of a large-scale artificial neural network is still very challenging due to unreliable analog weight modulation in current synaptic device technology. Here, we demonstrate a binarized neural network (BNN) based on a gate-all-around silicon nanosheet synaptic transistor, where reliable digital-type weight modulation can contribute to improve the sustainability of the entire network. BNN is applied to three proof-of-concept examples: (1) handwritten digit classification (MNIST dataset), (2) face image classification (Yale dataset), and (3) experimental 3 × 3 binary pattern classifications using an integrated synaptic transistor network (total 9 × 9 × 2   162 cells) through a supervised online training procedure. The results consolidate the feasibility of binarized neural networks and pave the way toward building a reliable and large-scale artificial neural network by using more advanced conventional digital device technologies.
format Online
Article
Text
id pubmed-6690903
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-66909032019-08-15 Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification Kim, Sungho Choi, Bongsik Yoon, Jinsu Lee, Yongwoo Kim, Hee-Dong Kang, Min-Ho Choi, Sung-Jin Sci Rep Article In the biological neural network, the learning process is achieved through massively parallel synaptic connections between neurons that can be adjusted in an analog manner. Recent developments in emerging synaptic devices and their networks can emulate the functionality of a biological neural network, which will be the fundamental building block for a neuromorphic computing architecture. However, on-chip implementation of a large-scale artificial neural network is still very challenging due to unreliable analog weight modulation in current synaptic device technology. Here, we demonstrate a binarized neural network (BNN) based on a gate-all-around silicon nanosheet synaptic transistor, where reliable digital-type weight modulation can contribute to improve the sustainability of the entire network. BNN is applied to three proof-of-concept examples: (1) handwritten digit classification (MNIST dataset), (2) face image classification (Yale dataset), and (3) experimental 3 × 3 binary pattern classifications using an integrated synaptic transistor network (total 9 × 9 × 2   162 cells) through a supervised online training procedure. The results consolidate the feasibility of binarized neural networks and pave the way toward building a reliable and large-scale artificial neural network by using more advanced conventional digital device technologies. Nature Publishing Group UK 2019-08-12 /pmc/articles/PMC6690903/ /pubmed/31406242 http://dx.doi.org/10.1038/s41598-019-48048-w Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Kim, Sungho
Choi, Bongsik
Yoon, Jinsu
Lee, Yongwoo
Kim, Hee-Dong
Kang, Min-Ho
Choi, Sung-Jin
Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title_full Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title_fullStr Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title_full_unstemmed Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title_short Binarized Neural Network with Silicon Nanosheet Synaptic Transistors for Supervised Pattern Classification
title_sort binarized neural network with silicon nanosheet synaptic transistors for supervised pattern classification
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6690903/
https://www.ncbi.nlm.nih.gov/pubmed/31406242
http://dx.doi.org/10.1038/s41598-019-48048-w
work_keys_str_mv AT kimsungho binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT choibongsik binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT yoonjinsu binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT leeyongwoo binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT kimheedong binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT kangminho binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification
AT choisungjin binarizedneuralnetworkwithsiliconnanosheetsynaptictransistorsforsupervisedpatternclassification