Cargando…

Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices

Deep learning produces a remarkable performance in various applications such as image classification and speech recognition. However, state-of-the-art deep neural networks require a large number of weights and enormous computation power, which results in a bottleneck of efficiency for edge-device ap...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Sung-Tae, Bae, Jong-Ho
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9696336/
https://www.ncbi.nlm.nih.gov/pubmed/36363821
http://dx.doi.org/10.3390/mi13111800
_version_ 1784838285617528832
author Lee, Sung-Tae
Bae, Jong-Ho
author_facet Lee, Sung-Tae
Bae, Jong-Ho
author_sort Lee, Sung-Tae
collection PubMed
description Deep learning produces a remarkable performance in various applications such as image classification and speech recognition. However, state-of-the-art deep neural networks require a large number of weights and enormous computation power, which results in a bottleneck of efficiency for edge-device applications. To resolve these problems, deep spiking neural networks (DSNNs) have been proposed, given the specialized synapse and neuron hardware. In this work, the hardware neuromorphic system of DSNNs with gated Schottky diodes was investigated. Gated Schottky diodes have a near-linear conductance response, which can easily implement quantized weights in synaptic devices. Based on modeling of synaptic devices, two-layer fully connected neural networks are trained by off-chip learning. The adaptation of a neuron’s threshold is proposed to reduce the accuracy degradation caused by the conversion from analog neural networks (ANNs) to event-driven DSNNs. Using left-justified rate coding as an input encoding method enables low-latency classification. The effect of device variation and noisy images to the classification accuracy is investigated. The time-to-first-spike (TTFS) scheme can significantly reduce power consumption by reducing the number of firing spikes compared to a max-firing scheme.
format Online
Article
Text
id pubmed-9696336
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96963362022-11-26 Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices Lee, Sung-Tae Bae, Jong-Ho Micromachines (Basel) Article Deep learning produces a remarkable performance in various applications such as image classification and speech recognition. However, state-of-the-art deep neural networks require a large number of weights and enormous computation power, which results in a bottleneck of efficiency for edge-device applications. To resolve these problems, deep spiking neural networks (DSNNs) have been proposed, given the specialized synapse and neuron hardware. In this work, the hardware neuromorphic system of DSNNs with gated Schottky diodes was investigated. Gated Schottky diodes have a near-linear conductance response, which can easily implement quantized weights in synaptic devices. Based on modeling of synaptic devices, two-layer fully connected neural networks are trained by off-chip learning. The adaptation of a neuron’s threshold is proposed to reduce the accuracy degradation caused by the conversion from analog neural networks (ANNs) to event-driven DSNNs. Using left-justified rate coding as an input encoding method enables low-latency classification. The effect of device variation and noisy images to the classification accuracy is investigated. The time-to-first-spike (TTFS) scheme can significantly reduce power consumption by reducing the number of firing spikes compared to a max-firing scheme. MDPI 2022-10-22 /pmc/articles/PMC9696336/ /pubmed/36363821 http://dx.doi.org/10.3390/mi13111800 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lee, Sung-Tae
Bae, Jong-Ho
Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title_full Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title_fullStr Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title_full_unstemmed Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title_short Investigation of Deep Spiking Neural Networks Utilizing Gated Schottky Diode as Synaptic Devices
title_sort investigation of deep spiking neural networks utilizing gated schottky diode as synaptic devices
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9696336/
https://www.ncbi.nlm.nih.gov/pubmed/36363821
http://dx.doi.org/10.3390/mi13111800
work_keys_str_mv AT leesungtae investigationofdeepspikingneuralnetworksutilizinggatedschottkydiodeassynapticdevices
AT baejongho investigationofdeepspikingneuralnetworksutilizinggatedschottkydiodeassynapticdevices