Cargando…
Simulation of Inference Accuracy Using Realistic RRAM Devices
Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6582938/ https://www.ncbi.nlm.nih.gov/pubmed/31249502 http://dx.doi.org/10.3389/fnins.2019.00593 |
_version_ | 1783428431207202816 |
---|---|
author | Mehonic, Adnan Joksas, Dovydas Ng, Wing H. Buckwell, Mark Kenyon, Anthony J. |
author_facet | Mehonic, Adnan Joksas, Dovydas Ng, Wing H. Buckwell, Mark Kenyon, Anthony J. |
author_sort | Mehonic, Adnan |
collection | PubMed |
description | Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use of RRAM devices in this potentially disruptive technology. Here we investigate the question for the case of inference. Using experimental results from silicon oxide (SiO(x)) RRAM devices, that we use as proxies for physical weights, we demonstrate that acceptable accuracies in classification of handwritten digits (MNIST data set) can be achieved using non-ideal devices. We find that, for this test, the ratio of the high- and low-resistance device states is a crucial determinant of classification accuracy, with ~96.8% accuracy achievable for ratios >3, compared to ~97.3% accuracy achieved with ideal weights. Further, we investigate the effects of a finite number of discrete resistance states, sub-100% device yield, devices stuck at one of the resistance states, current/voltage non-linearities, programming non-linearities and device-to-device variability. Detailed analysis of the effects of the non-idealities will better inform the need for the optimization of particular device properties. |
format | Online Article Text |
id | pubmed-6582938 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-65829382019-06-27 Simulation of Inference Accuracy Using Realistic RRAM Devices Mehonic, Adnan Joksas, Dovydas Ng, Wing H. Buckwell, Mark Kenyon, Anthony J. Front Neurosci Neuroscience Resistive Random Access Memory (RRAM) is a promising technology for power efficient hardware in applications of artificial intelligence (AI) and machine learning (ML) implemented in non-von Neumann architectures. However, there is an unanswered question if the device non-idealities preclude the use of RRAM devices in this potentially disruptive technology. Here we investigate the question for the case of inference. Using experimental results from silicon oxide (SiO(x)) RRAM devices, that we use as proxies for physical weights, we demonstrate that acceptable accuracies in classification of handwritten digits (MNIST data set) can be achieved using non-ideal devices. We find that, for this test, the ratio of the high- and low-resistance device states is a crucial determinant of classification accuracy, with ~96.8% accuracy achievable for ratios >3, compared to ~97.3% accuracy achieved with ideal weights. Further, we investigate the effects of a finite number of discrete resistance states, sub-100% device yield, devices stuck at one of the resistance states, current/voltage non-linearities, programming non-linearities and device-to-device variability. Detailed analysis of the effects of the non-idealities will better inform the need for the optimization of particular device properties. Frontiers Media S.A. 2019-06-12 /pmc/articles/PMC6582938/ /pubmed/31249502 http://dx.doi.org/10.3389/fnins.2019.00593 Text en Copyright © 2019 Mehonic, Joksas, Ng, Buckwell and Kenyon. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Mehonic, Adnan Joksas, Dovydas Ng, Wing H. Buckwell, Mark Kenyon, Anthony J. Simulation of Inference Accuracy Using Realistic RRAM Devices |
title | Simulation of Inference Accuracy Using Realistic RRAM Devices |
title_full | Simulation of Inference Accuracy Using Realistic RRAM Devices |
title_fullStr | Simulation of Inference Accuracy Using Realistic RRAM Devices |
title_full_unstemmed | Simulation of Inference Accuracy Using Realistic RRAM Devices |
title_short | Simulation of Inference Accuracy Using Realistic RRAM Devices |
title_sort | simulation of inference accuracy using realistic rram devices |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6582938/ https://www.ncbi.nlm.nih.gov/pubmed/31249502 http://dx.doi.org/10.3389/fnins.2019.00593 |
work_keys_str_mv | AT mehonicadnan simulationofinferenceaccuracyusingrealisticrramdevices AT joksasdovydas simulationofinferenceaccuracyusingrealisticrramdevices AT ngwingh simulationofinferenceaccuracyusingrealisticrramdevices AT buckwellmark simulationofinferenceaccuracyusingrealisticrramdevices AT kenyonanthonyj simulationofinferenceaccuracyusingrealisticrramdevices |