Cargando…

Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update

Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device prop...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Taeyoon, Hu, Suman, Kim, Jaewook, Kwak, Joon Young, Park, Jongkil, Lee, Suyoun, Kim, Inho, Park, Jong-Keuk, Jeong, YeonJoo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7996210/
https://www.ncbi.nlm.nih.gov/pubmed/33776676
http://dx.doi.org/10.3389/fncom.2021.646125
_version_ 1783670065840783360
author Kim, Taeyoon
Hu, Suman
Kim, Jaewook
Kwak, Joon Young
Park, Jongkil
Lee, Suyoun
Kim, Inho
Park, Jong-Keuk
Jeong, YeonJoo
author_facet Kim, Taeyoon
Hu, Suman
Kim, Jaewook
Kwak, Joon Young
Park, Jongkil
Lee, Suyoun
Kim, Inho
Park, Jong-Keuk
Jeong, YeonJoo
author_sort Kim, Taeyoon
collection PubMed
description Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device properties are making it challengeable. In this work, we conducted an SNN simulation by adding a device model with a non-linear weight update to test the impact on SNN performance. We found that SNN has a strong tolerance for the device non-linearity and the network can keep the accuracy high if a device meets one of the two conditions: 1. symmetric LTP and LTD curves and 2. positive non-linearity factors for both LTP and LTD. The reason was analyzed in terms of the balance between network parameters as well as the variability of weight. The results are considered to be a piece of useful prior information for the future implementation of emerging device-based neuromorphic hardware.
format Online
Article
Text
id pubmed-7996210
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-79962102021-03-27 Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update Kim, Taeyoon Hu, Suman Kim, Jaewook Kwak, Joon Young Park, Jongkil Lee, Suyoun Kim, Inho Park, Jong-Keuk Jeong, YeonJoo Front Comput Neurosci Neuroscience Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device properties are making it challengeable. In this work, we conducted an SNN simulation by adding a device model with a non-linear weight update to test the impact on SNN performance. We found that SNN has a strong tolerance for the device non-linearity and the network can keep the accuracy high if a device meets one of the two conditions: 1. symmetric LTP and LTD curves and 2. positive non-linearity factors for both LTP and LTD. The reason was analyzed in terms of the balance between network parameters as well as the variability of weight. The results are considered to be a piece of useful prior information for the future implementation of emerging device-based neuromorphic hardware. Frontiers Media S.A. 2021-03-11 /pmc/articles/PMC7996210/ /pubmed/33776676 http://dx.doi.org/10.3389/fncom.2021.646125 Text en Copyright © 2021 Kim, Hu, Kim, Kwak, Park, Lee, Kim, Park and Jeong. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Kim, Taeyoon
Hu, Suman
Kim, Jaewook
Kwak, Joon Young
Park, Jongkil
Lee, Suyoun
Kim, Inho
Park, Jong-Keuk
Jeong, YeonJoo
Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title_full Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title_fullStr Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title_full_unstemmed Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title_short Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
title_sort spiking neural network (snn) with memristor synapses having non-linear weight update
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7996210/
https://www.ncbi.nlm.nih.gov/pubmed/33776676
http://dx.doi.org/10.3389/fncom.2021.646125
work_keys_str_mv AT kimtaeyoon spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT husuman spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT kimjaewook spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT kwakjoonyoung spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT parkjongkil spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT leesuyoun spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT kiminho spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT parkjongkeuk spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate
AT jeongyeonjoo spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate