Cargando…

Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays

Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning...

Descripción completa

Detalles Bibliográficos
Autores principales: Shi, Yuhan, Nguyen, Leon, Oh, Sangheon, Liu, Xin, Koushan, Foroozan, Jameson, John R., Kuzum, Duygu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6294253/
https://www.ncbi.nlm.nih.gov/pubmed/30552329
http://dx.doi.org/10.1038/s41467-018-07682-0
_version_ 1783380707533389824
author Shi, Yuhan
Nguyen, Leon
Oh, Sangheon
Liu, Xin
Koushan, Foroozan
Jameson, John R.
Kuzum, Duygu
author_facet Shi, Yuhan
Nguyen, Leon
Oh, Sangheon
Liu, Xin
Koushan, Foroozan
Jameson, John R.
Kuzum, Duygu
author_sort Shi, Yuhan
collection PubMed
description Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning technique to reduce network level energy consumption. First, we demonstrate low energy subquantum CBRAM devices exhibiting gradual switching characteristics important for implementing weight updates in hardware during unsupervised learning. Then we develop a network pruning algorithm that can be employed during training, different from previous network pruning approaches applied for inference only. Using a 512 kbit subquantum CBRAM array, we experimentally demonstrate high recognition accuracy on the MNIST dataset for digital implementation of unsupervised learning. Our hardware/software co-design approach can pave the way towards resistive memory based neuro-inspired systems that can autonomously learn and process information in power-limited settings.
format Online
Article
Text
id pubmed-6294253
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-62942532018-12-17 Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays Shi, Yuhan Nguyen, Leon Oh, Sangheon Liu, Xin Koushan, Foroozan Jameson, John R. Kuzum, Duygu Nat Commun Article Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning technique to reduce network level energy consumption. First, we demonstrate low energy subquantum CBRAM devices exhibiting gradual switching characteristics important for implementing weight updates in hardware during unsupervised learning. Then we develop a network pruning algorithm that can be employed during training, different from previous network pruning approaches applied for inference only. Using a 512 kbit subquantum CBRAM array, we experimentally demonstrate high recognition accuracy on the MNIST dataset for digital implementation of unsupervised learning. Our hardware/software co-design approach can pave the way towards resistive memory based neuro-inspired systems that can autonomously learn and process information in power-limited settings. Nature Publishing Group UK 2018-12-14 /pmc/articles/PMC6294253/ /pubmed/30552329 http://dx.doi.org/10.1038/s41467-018-07682-0 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Shi, Yuhan
Nguyen, Leon
Oh, Sangheon
Liu, Xin
Koushan, Foroozan
Jameson, John R.
Kuzum, Duygu
Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title_full Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title_fullStr Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title_full_unstemmed Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title_short Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
title_sort neuroinspired unsupervised learning and pruning with subquantum cbram arrays
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6294253/
https://www.ncbi.nlm.nih.gov/pubmed/30552329
http://dx.doi.org/10.1038/s41467-018-07682-0
work_keys_str_mv AT shiyuhan neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT nguyenleon neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT ohsangheon neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT liuxin neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT koushanforoozan neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT jamesonjohnr neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays
AT kuzumduygu neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays