Cargando…

Simulation of Inference Accuracy Using Realistic RRAM Devices

Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use...

Descripción completa

Detalles Bibliográficos
Autores principales: Mehonic, Adnan, Joksas, Dovydas, Ng, Wing H., Buckwell, Mark, Kenyon, Anthony J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6582938/
https://www.ncbi.nlm.nih.gov/pubmed/31249502
http://dx.doi.org/10.3389/fnins.2019.00593
_version_ 1783428431207202816
author Mehonic, Adnan
Joksas, Dovydas
Ng, Wing H.
Buckwell, Mark
Kenyon, Anthony J.
author_facet Mehonic, Adnan
Joksas, Dovydas
Ng, Wing H.
Buckwell, Mark
Kenyon, Anthony J.
author_sort Mehonic, Adnan
collection PubMed
description Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use of RRAM devices in this potentially disruptive technology. Here we investigate the question for the case of inference. Using experimental results from silicon oxide (SiO(x)) RRAM devices, that we use as proxies for physical weights, we demonstrate that acceptable accuracies in classification of handwritten digits (MNIST data set) can be achieved using non-ideal devices. We find that, for this test, the ratio of the high- and low-resistance device states is a crucial determinant of classification accuracy, with ~96.8% accuracy achievable for ratios >3, compared to ~97.3% accuracy achieved with ideal weights. Further, we investigate the effects of a finite number of discrete resistance states, sub-100% device yield, devices stuck at one of the resistance states, current/voltage non-linearities, programming non-linearities and device-to-device variability. Detailed analysis of the effects of the non-idealities will better inform the need for the optimization of particular device properties.
format Online
Article
Text
id pubmed-6582938
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-65829382019-06-27 Simulation of Inference Accuracy Using Realistic RRAM Devices Mehonic, Adnan Joksas, Dovydas Ng, Wing H. Buckwell, Mark Kenyon, Anthony J. Front Neurosci Neuroscience Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use of RRAM devices in this potentially disruptive technology. Here we investigate the question for the case of inference. Using experimental results from silicon oxide (SiO(x)) RRAM devices, that we use as proxies for physical weights, we demonstrate that acceptable accuracies in classification of handwritten digits (MNIST data set) can be achieved using non-ideal devices. We find that, for this test, the ratio of the high- and low-resistance device states is a crucial determinant of classification accuracy, with ~96.8% accuracy achievable for ratios >3, compared to ~97.3% accuracy achieved with ideal weights. Further, we investigate the effects of a finite number of discrete resistance states, sub-100% device yield, devices stuck at one of the resistance states, current/voltage non-linearities, programming non-linearities and device-to-device variability. Detailed analysis of the effects of the non-idealities will better inform the need for the optimization of particular device properties. Frontiers Media S.A. 2019-06-12 /pmc/articles/PMC6582938/ /pubmed/31249502 http://dx.doi.org/10.3389/fnins.2019.00593 Text en Copyright © 2019 Mehonic, Joksas, Ng, Buckwell and Kenyon. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Mehonic, Adnan
Joksas, Dovydas
Ng, Wing H.
Buckwell, Mark
Kenyon, Anthony J.
Simulation of Inference Accuracy Using Realistic RRAM Devices
title Simulation of Inference Accuracy Using Realistic RRAM Devices
title_full Simulation of Inference Accuracy Using Realistic RRAM Devices
title_fullStr Simulation of Inference Accuracy Using Realistic RRAM Devices
title_full_unstemmed Simulation of Inference Accuracy Using Realistic RRAM Devices
title_short Simulation of Inference Accuracy Using Realistic RRAM Devices
title_sort simulation of inference accuracy using realistic rram devices
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6582938/
https://www.ncbi.nlm.nih.gov/pubmed/31249502
http://dx.doi.org/10.3389/fnins.2019.00593
work_keys_str_mv AT mehonicadnan simulationofinferenceaccuracyusingrealisticrramdevices
AT joksasdovydas simulationofinferenceaccuracyusingrealisticrramdevices
AT ngwingh simulationofinferenceaccuracyusingrealisticrramdevices
AT buckwellmark simulationofinferenceaccuracyusingrealisticrramdevices
AT kenyonanthonyj simulationofinferenceaccuracyusingrealisticrramdevices