Cargando…

Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system

Lately, there has been a rapid increase in the use of software-based deep learning neural networks (S-DNN) for the analysis of unstructured data consumption. For implementation of the S-DNN, synapse-device-based hardware DNN (H-DNN) has been proposed as an alternative to typical Von-Neumann structur...

Descripción completa

Detalles Bibliográficos
Autores principales: Han, Geonhui, Lee, Chuljun, Lee, Jae-Eun, Seo, Jongseon, Kim, Myungjun, Song, Yubin, Seo, Young-Ho, Lee, Daeseok
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8636521/
https://www.ncbi.nlm.nih.gov/pubmed/34853319
http://dx.doi.org/10.1038/s41598-021-02176-4
_version_ 1784608546570108928
author Han, Geonhui
Lee, Chuljun
Lee, Jae-Eun
Seo, Jongseon
Kim, Myungjun
Song, Yubin
Seo, Young-Ho
Lee, Daeseok
author_facet Han, Geonhui
Lee, Chuljun
Lee, Jae-Eun
Seo, Jongseon
Kim, Myungjun
Song, Yubin
Seo, Young-Ho
Lee, Daeseok
author_sort Han, Geonhui
collection PubMed
description Lately, there has been a rapid increase in the use of software-based deep learning neural networks (S-DNN) for the analysis of unstructured data consumption. For implementation of the S-DNN, synapse-device-based hardware DNN (H-DNN) has been proposed as an alternative to typical Von-Neumann structural computing systems. In the H-DNN, various numerical values such as the synaptic weight, activation function, and etc., have to be realized through electrical device or circuit. Among them, the synaptic weight that should have both positive and negative numerical values needs to be implemented in a simpler way. Because the synaptic weight has been expressed by conductance value of the synapse device, it always has a positive value. Therefore, typically, a pair of synapse devices is required to realize the negative weight values, which leads to additional hardware resources such as more devices, higher power consumption, larger area, and increased circuit complexity. Herein, we propose an alternative simpler method to realize the negative weight (named weight shifter) and its hardware implementation. To demonstrate the weight shifter, we investigated its theoretical, numerical, and circuit-related aspects, following which the H-DNN circuit was successfully implemented on a printed circuit board.
format Online
Article
Text
id pubmed-8636521
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-86365212021-12-03 Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system Han, Geonhui Lee, Chuljun Lee, Jae-Eun Seo, Jongseon Kim, Myungjun Song, Yubin Seo, Young-Ho Lee, Daeseok Sci Rep Article Lately, there has been a rapid increase in the use of software-based deep learning neural networks (S-DNN) for the analysis of unstructured data consumption. For implementation of the S-DNN, synapse-device-based hardware DNN (H-DNN) has been proposed as an alternative to typical Von-Neumann structural computing systems. In the H-DNN, various numerical values such as the synaptic weight, activation function, and etc., have to be realized through electrical device or circuit. Among them, the synaptic weight that should have both positive and negative numerical values needs to be implemented in a simpler way. Because the synaptic weight has been expressed by conductance value of the synapse device, it always has a positive value. Therefore, typically, a pair of synapse devices is required to realize the negative weight values, which leads to additional hardware resources such as more devices, higher power consumption, larger area, and increased circuit complexity. Herein, we propose an alternative simpler method to realize the negative weight (named weight shifter) and its hardware implementation. To demonstrate the weight shifter, we investigated its theoretical, numerical, and circuit-related aspects, following which the H-DNN circuit was successfully implemented on a printed circuit board. Nature Publishing Group UK 2021-12-01 /pmc/articles/PMC8636521/ /pubmed/34853319 http://dx.doi.org/10.1038/s41598-021-02176-4 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Han, Geonhui
Lee, Chuljun
Lee, Jae-Eun
Seo, Jongseon
Kim, Myungjun
Song, Yubin
Seo, Young-Ho
Lee, Daeseok
Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title_full Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title_fullStr Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title_full_unstemmed Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title_short Alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
title_sort alternative negative weight for simpler hardware implementation of synapse device based neuromorphic system
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8636521/
https://www.ncbi.nlm.nih.gov/pubmed/34853319
http://dx.doi.org/10.1038/s41598-021-02176-4
work_keys_str_mv AT hangeonhui alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT leechuljun alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT leejaeeun alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT seojongseon alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT kimmyungjun alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT songyubin alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT seoyoungho alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem
AT leedaeseok alternativenegativeweightforsimplerhardwareimplementationofsynapsedevicebasedneuromorphicsystem