Cargando…
Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6294253/ https://www.ncbi.nlm.nih.gov/pubmed/30552329 http://dx.doi.org/10.1038/s41467-018-07682-0 |
_version_ | 1783380707533389824 |
---|---|
author | Shi, Yuhan Nguyen, Leon Oh, Sangheon Liu, Xin Koushan, Foroozan Jameson, John R. Kuzum, Duygu |
author_facet | Shi, Yuhan Nguyen, Leon Oh, Sangheon Liu, Xin Koushan, Foroozan Jameson, John R. Kuzum, Duygu |
author_sort | Shi, Yuhan |
collection | PubMed |
description | Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning technique to reduce network level energy consumption. First, we demonstrate low energy subquantum CBRAM devices exhibiting gradual switching characteristics important for implementing weight updates in hardware during unsupervised learning. Then we develop a network pruning algorithm that can be employed during training, different from previous network pruning approaches applied for inference only. Using a 512 kbit subquantum CBRAM array, we experimentally demonstrate high recognition accuracy on the MNIST dataset for digital implementation of unsupervised learning. Our hardware/software co-design approach can pave the way towards resistive memory based neuro-inspired systems that can autonomously learn and process information in power-limited settings. |
format | Online Article Text |
id | pubmed-6294253 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-62942532018-12-17 Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays Shi, Yuhan Nguyen, Leon Oh, Sangheon Liu, Xin Koushan, Foroozan Jameson, John R. Kuzum, Duygu Nat Commun Article Resistive RAM crossbar arrays offer an attractive solution to minimize off-chip data transfer and parallelize on-chip computations for neural networks. Here, we report a hardware/software co-design approach based on low energy subquantum conductive bridging RAM (CBRAM®) devices and a network pruning technique to reduce network level energy consumption. First, we demonstrate low energy subquantum CBRAM devices exhibiting gradual switching characteristics important for implementing weight updates in hardware during unsupervised learning. Then we develop a network pruning algorithm that can be employed during training, different from previous network pruning approaches applied for inference only. Using a 512 kbit subquantum CBRAM array, we experimentally demonstrate high recognition accuracy on the MNIST dataset for digital implementation of unsupervised learning. Our hardware/software co-design approach can pave the way towards resistive memory based neuro-inspired systems that can autonomously learn and process information in power-limited settings. Nature Publishing Group UK 2018-12-14 /pmc/articles/PMC6294253/ /pubmed/30552329 http://dx.doi.org/10.1038/s41467-018-07682-0 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Shi, Yuhan Nguyen, Leon Oh, Sangheon Liu, Xin Koushan, Foroozan Jameson, John R. Kuzum, Duygu Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title | Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title_full | Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title_fullStr | Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title_full_unstemmed | Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title_short | Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays |
title_sort | neuroinspired unsupervised learning and pruning with subquantum cbram arrays |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6294253/ https://www.ncbi.nlm.nih.gov/pubmed/30552329 http://dx.doi.org/10.1038/s41467-018-07682-0 |
work_keys_str_mv | AT shiyuhan neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT nguyenleon neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT ohsangheon neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT liuxin neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT koushanforoozan neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT jamesonjohnr neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays AT kuzumduygu neuroinspiredunsupervisedlearningandpruningwithsubquantumcbramarrays |