Cargando…
Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update
Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device prop...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7996210/ https://www.ncbi.nlm.nih.gov/pubmed/33776676 http://dx.doi.org/10.3389/fncom.2021.646125 |
_version_ | 1783670065840783360 |
---|---|
author | Kim, Taeyoon Hu, Suman Kim, Jaewook Kwak, Joon Young Park, Jongkil Lee, Suyoun Kim, Inho Park, Jong-Keuk Jeong, YeonJoo |
author_facet | Kim, Taeyoon Hu, Suman Kim, Jaewook Kwak, Joon Young Park, Jongkil Lee, Suyoun Kim, Inho Park, Jong-Keuk Jeong, YeonJoo |
author_sort | Kim, Taeyoon |
collection | PubMed |
description | Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device properties are making it challengeable. In this work, we conducted an SNN simulation by adding a device model with a non-linear weight update to test the impact on SNN performance. We found that SNN has a strong tolerance for the device non-linearity and the network can keep the accuracy high if a device meets one of the two conditions: 1. symmetric LTP and LTD curves and 2. positive non-linearity factors for both LTP and LTD. The reason was analyzed in terms of the balance between network parameters as well as the variability of weight. The results are considered to be a piece of useful prior information for the future implementation of emerging device-based neuromorphic hardware. |
format | Online Article Text |
id | pubmed-7996210 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79962102021-03-27 Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update Kim, Taeyoon Hu, Suman Kim, Jaewook Kwak, Joon Young Park, Jongkil Lee, Suyoun Kim, Inho Park, Jong-Keuk Jeong, YeonJoo Front Comput Neurosci Neuroscience Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device properties are making it challengeable. In this work, we conducted an SNN simulation by adding a device model with a non-linear weight update to test the impact on SNN performance. We found that SNN has a strong tolerance for the device non-linearity and the network can keep the accuracy high if a device meets one of the two conditions: 1. symmetric LTP and LTD curves and 2. positive non-linearity factors for both LTP and LTD. The reason was analyzed in terms of the balance between network parameters as well as the variability of weight. The results are considered to be a piece of useful prior information for the future implementation of emerging device-based neuromorphic hardware. Frontiers Media S.A. 2021-03-11 /pmc/articles/PMC7996210/ /pubmed/33776676 http://dx.doi.org/10.3389/fncom.2021.646125 Text en Copyright © 2021 Kim, Hu, Kim, Kwak, Park, Lee, Kim, Park and Jeong. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Kim, Taeyoon Hu, Suman Kim, Jaewook Kwak, Joon Young Park, Jongkil Lee, Suyoun Kim, Inho Park, Jong-Keuk Jeong, YeonJoo Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title | Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title_full | Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title_fullStr | Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title_full_unstemmed | Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title_short | Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update |
title_sort | spiking neural network (snn) with memristor synapses having non-linear weight update |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7996210/ https://www.ncbi.nlm.nih.gov/pubmed/33776676 http://dx.doi.org/10.3389/fncom.2021.646125 |
work_keys_str_mv | AT kimtaeyoon spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT husuman spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT kimjaewook spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT kwakjoonyoung spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT parkjongkil spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT leesuyoun spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT kiminho spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT parkjongkeuk spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate AT jeongyeonjoo spikingneuralnetworksnnwithmemristorsynapseshavingnonlinearweightupdate |