Cargando…

Flash-based content addressable memory with L2 distance for memory-augmented neural network

Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Haozhang, Huang, Peng, Li, Ruiyi, Tang, Nan, Zhang, Yizhou, Zhou, Zheng, Liu, Lifeng, Liu, Xiaoyan, Kang, Jinfeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663817/
https://www.ncbi.nlm.nih.gov/pubmed/38025791
http://dx.doi.org/10.1016/j.isci.2023.108371
_version_ 1785138483445104640
author Yang, Haozhang
Huang, Peng
Li, Ruiyi
Tang, Nan
Zhang, Yizhou
Zhou, Zheng
Liu, Lifeng
Liu, Xiaoyan
Kang, Jinfeng
author_facet Yang, Haozhang
Huang, Peng
Li, Ruiyi
Tang, Nan
Zhang, Yizhou
Zhou, Zheng
Liu, Lifeng
Liu, Xiaoyan
Kang, Jinfeng
author_sort Yang, Haozhang
collection PubMed
description Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-memory-computing capability. In this work, a CAM cell with quadratic code is proposed, and a 1Mb Flash-based multi-bit CAM chip capable of computing Euclidean (L2) distance is fabricated. Compared with ternary CAM, the latency and energy are significantly reduced by 5.3- and 46.6-fold, respectively, for the MANN on Omniglot dataset. Besides, the recognition accuracy has slight degradation (<1%) even after baking for 10(5) s at 200°C, demonstrating the robustness to environmental disturbance. Performance evaluation indicates a reduction of 471-fold in latency and 1267-fold in energy compared with GPU for search operation. The proposed robust and energy-efficient CAM provides a promising solution to implement lifelong on-device machine intelligence.
format Online
Article
Text
id pubmed-10663817
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-106638172023-10-31 Flash-based content addressable memory with L2 distance for memory-augmented neural network Yang, Haozhang Huang, Peng Li, Ruiyi Tang, Nan Zhang, Yizhou Zhou, Zheng Liu, Lifeng Liu, Xiaoyan Kang, Jinfeng iScience Article Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-memory-computing capability. In this work, a CAM cell with quadratic code is proposed, and a 1Mb Flash-based multi-bit CAM chip capable of computing Euclidean (L2) distance is fabricated. Compared with ternary CAM, the latency and energy are significantly reduced by 5.3- and 46.6-fold, respectively, for the MANN on Omniglot dataset. Besides, the recognition accuracy has slight degradation (<1%) even after baking for 10(5) s at 200°C, demonstrating the robustness to environmental disturbance. Performance evaluation indicates a reduction of 471-fold in latency and 1267-fold in energy compared with GPU for search operation. The proposed robust and energy-efficient CAM provides a promising solution to implement lifelong on-device machine intelligence. Elsevier 2023-10-31 /pmc/articles/PMC10663817/ /pubmed/38025791 http://dx.doi.org/10.1016/j.isci.2023.108371 Text en © 2023 The Author(s) https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Article
Yang, Haozhang
Huang, Peng
Li, Ruiyi
Tang, Nan
Zhang, Yizhou
Zhou, Zheng
Liu, Lifeng
Liu, Xiaoyan
Kang, Jinfeng
Flash-based content addressable memory with L2 distance for memory-augmented neural network
title Flash-based content addressable memory with L2 distance for memory-augmented neural network
title_full Flash-based content addressable memory with L2 distance for memory-augmented neural network
title_fullStr Flash-based content addressable memory with L2 distance for memory-augmented neural network
title_full_unstemmed Flash-based content addressable memory with L2 distance for memory-augmented neural network
title_short Flash-based content addressable memory with L2 distance for memory-augmented neural network
title_sort flash-based content addressable memory with l2 distance for memory-augmented neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663817/
https://www.ncbi.nlm.nih.gov/pubmed/38025791
http://dx.doi.org/10.1016/j.isci.2023.108371
work_keys_str_mv AT yanghaozhang flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT huangpeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT liruiyi flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT tangnan flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT zhangyizhou flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT zhouzheng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT liulifeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT liuxiaoyan flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork
AT kangjinfeng flashbasedcontentaddressablememorywithl2distanceformemoryaugmentedneuralnetwork