Cargando…

Memristor Neural Network Training with Clock Synchronous Neuromorphic System

Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsuper...

Descripción completa

Detalles Bibliográficos
Autores principales: Jo, Sumin, Sun, Wookyung, Kim, Bokyung, Kim, Sunhee, Park, Junhee, Shin, Hyungsoon
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6632029/
https://www.ncbi.nlm.nih.gov/pubmed/31181763
http://dx.doi.org/10.3390/mi10060384
_version_ 1783435657709879296
author Jo, Sumin
Sun, Wookyung
Kim, Bokyung
Kim, Sunhee
Park, Junhee
Shin, Hyungsoon
author_facet Jo, Sumin
Sun, Wookyung
Kim, Bokyung
Kim, Sunhee
Park, Junhee
Shin, Hyungsoon
author_sort Jo, Sumin
collection PubMed
description Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods.
format Online
Article
Text
id pubmed-6632029
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-66320292019-08-19 Memristor Neural Network Training with Clock Synchronous Neuromorphic System Jo, Sumin Sun, Wookyung Kim, Bokyung Kim, Sunhee Park, Junhee Shin, Hyungsoon Micromachines (Basel) Article Memristor devices are considered to have the potential to implement unsupervised learning, especially spike timing-dependent plasticity (STDP), in the field of neuromorphic hardware research. In this study, a neuromorphic hardware system for multilayer unsupervised learning was designed, and unsupervised learning was performed with a memristor neural network. We showed that the nonlinear characteristic memristor neural network can be trained by unsupervised learning only with the correlation between inputs and outputs. Moreover, a method to train nonlinear memristor devices in a supervised manner, named guide training, was devised. Memristor devices have a nonlinear characteristic, which makes implementing machine learning algorithms, such as backpropagation, difficult. The guide-training algorithm devised in this paper updates the synaptic weights by only using the correlations between inputs and outputs, and therefore, neither complex mathematical formulas nor computations are required during the training. Thus, it is considered appropriate to train a nonlinear memristor neural network. All training and inference simulations were performed using the designed neuromorphic hardware system. With the system and memristor neural network, the image classification was successfully done using both the Hebbian unsupervised training and guide supervised training methods. MDPI 2019-06-08 /pmc/articles/PMC6632029/ /pubmed/31181763 http://dx.doi.org/10.3390/mi10060384 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Jo, Sumin
Sun, Wookyung
Kim, Bokyung
Kim, Sunhee
Park, Junhee
Shin, Hyungsoon
Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title_full Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title_fullStr Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title_full_unstemmed Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title_short Memristor Neural Network Training with Clock Synchronous Neuromorphic System
title_sort memristor neural network training with clock synchronous neuromorphic system
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6632029/
https://www.ncbi.nlm.nih.gov/pubmed/31181763
http://dx.doi.org/10.3390/mi10060384
work_keys_str_mv AT josumin memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem
AT sunwookyung memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem
AT kimbokyung memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem
AT kimsunhee memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem
AT parkjunhee memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem
AT shinhyungsoon memristorneuralnetworktrainingwithclocksynchronousneuromorphicsystem