Cargando…
Flash-based content addressable memory with L2 distance for memory-augmented neural network
Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663817/ https://www.ncbi.nlm.nih.gov/pubmed/38025791 http://dx.doi.org/10.1016/j.isci.2023.108371 |
_version_ | 1785138483445104640 |
---|---|
author | Yang, Haozhang Huang, Peng Li, Ruiyi Tang, Nan Zhang, Yizhou Zhou, Zheng Liu, Lifeng Liu, Xiaoyan Kang, Jinfeng |
author_facet | Yang, Haozhang Huang, Peng Li, Ruiyi Tang, Nan Zhang, Yizhou Zhou, Zheng Liu, Lifeng Liu, Xiaoyan Kang, Jinfeng |
author_sort | Yang, Haozhang |
collection | PubMed |
description | Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-memory-computing capability. In this work, a CAM cell with quadratic code is proposed, and a 1Mb Flash-based multi-bit CAM chip capable of computing Euclidean (L2) distance is fabricated. Compared with ternary CAM, the latency and energy are significantly reduced by 5.3- and 46.6-fold, respectively, for the MANN on Omniglot dataset. Besides, the recognition accuracy has slight degradation (<1%) even after baking for 10(5) s at 200°C, demonstrating the robustness to environmental disturbance. Performance evaluation indicates a reduction of 471-fold in latency and 1267-fold in energy compared with GPU for search operation. The proposed robust and energy-efficient CAM provides a promising solution to implement lifelong on-device machine intelligence. |
format | Online Article Text |
id | pubmed-10663817 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-106638172023-10-31 Flash-based content addressable memory with L2 distance for memory-augmented neural network Yang, Haozhang Huang, Peng Li, Ruiyi Tang, Nan Zhang, Yizhou Zhou, Zheng Liu, Lifeng Liu, Xiaoyan Kang, Jinfeng iScience Article Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-memory-computing capability. In this work, a CAM cell with quadratic code is proposed, and a 1Mb Flash-based multi-bit CAM chip capable of computing Euclidean (L2) distance is fabricated. Compared with ternary CAM, the latency and energy are significantly reduced by 5.3- and 46.6-fold, respectively, for the MANN on Omniglot dataset. Besides, the recognition accuracy has slight degradation (<1%) even after baking for 10(5) s at 200°C, demonstrating the robustness to environmental disturbance. Performance evaluation indicates a reduction of 471-fold in latency and 1267-fold in energy compared with GPU for search operation. The proposed robust and energy-efficient CAM provides a promising solution to implement lifelong on-device machine intelligence. Elsevier 2023-10-31 /pmc/articles/PMC10663817/ /pubmed/38025791 http://dx.doi.org/10.1016/j.isci.2023.108371 Text en © 2023 The Author(s) https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Article Yang, Haozhang Huang, Peng Li, Ruiyi Tang, Nan Zhang, Yizhou Zhou, Zheng Liu, Lifeng Liu, Xiaoyan Kang, Jinfeng Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title | Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title_full | Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title_fullStr | Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title_full_unstemmed | Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title_short | Flash-based content addressable memory with L2 distance for memory-augmented neural network |
title_sort | flash-based content addressable memory with l2 distance for memory-augmented neural network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663817/ https://www.ncbi.nlm.nih.gov/pubmed/38025791 http://dx.doi.org/10.1016/j.isci.2023.108371 |
work_keys_str_mv | AT yanghaozhang flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT huangpeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT liruiyi flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT tangnan flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT zhangyizhou flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT zhouzheng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT liulifeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT liuxiaoyan flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork AT kangjinfeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork |