Cargando…
MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9037635/ https://www.ncbi.nlm.nih.gov/pubmed/35478844 http://dx.doi.org/10.3389/fnins.2022.775457 |
_version_ | 1784693763676831744 |
---|---|
author | Kim, Daehyun Chakraborty, Biswadeep She, Xueyuan Lee, Edward Kang, Beomseok Mukhopadhyay, Saibal |
author_facet | Kim, Daehyun Chakraborty, Biswadeep She, Xueyuan Lee, Edward Kang, Beomseok Mukhopadhyay, Saibal |
author_sort | Kim, Daehyun |
collection | PubMed |
description | We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented with spike-time-dependent-plasticity (STDP) based weight update. The spiking neural network (SNN)-focused data flow is presented to minimize data movement in MONETAwhile ensuring learning accuracy. MONETAsupports on-line and on-chip training on PIM architecture. The STDP-trained convolutional neural network within SNN (ConvSNN) with the proposed data flow, 4-bit input precision, and 8-bit weight precision shows only 1.63% lower accuracy in CIFAR-10 compared to the STDP accuracy implemented by the software. Further, the proposed architecture is used to accelerate a hybrid SNN architecture that couples off-chip supervised (back propagation through time) and on-chip unsupervised (STDP) training. We also evaluate the hybrid network architecture with the proposed data flow. The accuracy of this hybrid network is 10.84% higher than STDP trained accuracy result and 1.4% higher compared to the backpropagated training-based ConvSNN result with the CIFAR-10 dataset. Physical design of MONETAin 65 nm complementary metal-oxide-semiconductor (CMOS) shows 18.69 tera operation per second (TOPS)/W, 7.25 TOPS/W and 10.41 TOPS/W power efficiencies for the inference mode, learning mode, and hybrid learning mode, respectively. |
format | Online Article Text |
id | pubmed-9037635 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90376352022-04-26 MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning Kim, Daehyun Chakraborty, Biswadeep She, Xueyuan Lee, Edward Kang, Beomseok Mukhopadhyay, Saibal Front Neurosci Neuroscience We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented with spike-time-dependent-plasticity (STDP) based weight update. The spiking neural network (SNN)-focused data flow is presented to minimize data movement in MONETAwhile ensuring learning accuracy. MONETAsupports on-line and on-chip training on PIM architecture. The STDP-trained convolutional neural network within SNN (ConvSNN) with the proposed data flow, 4-bit input precision, and 8-bit weight precision shows only 1.63% lower accuracy in CIFAR-10 compared to the STDP accuracy implemented by the software. Further, the proposed architecture is used to accelerate a hybrid SNN architecture that couples off-chip supervised (back propagation through time) and on-chip unsupervised (STDP) training. We also evaluate the hybrid network architecture with the proposed data flow. The accuracy of this hybrid network is 10.84% higher than STDP trained accuracy result and 1.4% higher compared to the backpropagated training-based ConvSNN result with the CIFAR-10 dataset. Physical design of MONETAin 65 nm complementary metal-oxide-semiconductor (CMOS) shows 18.69 tera operation per second (TOPS)/W, 7.25 TOPS/W and 10.41 TOPS/W power efficiencies for the inference mode, learning mode, and hybrid learning mode, respectively. Frontiers Media S.A. 2022-04-11 /pmc/articles/PMC9037635/ /pubmed/35478844 http://dx.doi.org/10.3389/fnins.2022.775457 Text en Copyright © 2022 Kim, Chakraborty, She, Lee, Kang and Mukhopadhyay. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Kim, Daehyun Chakraborty, Biswadeep She, Xueyuan Lee, Edward Kang, Beomseok Mukhopadhyay, Saibal MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title | MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title_full | MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title_fullStr | MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title_full_unstemmed | MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title_short | MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning |
title_sort | moneta: a processing-in-memory-based hardware platform for the hybrid convolutional spiking neural network with online learning |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9037635/ https://www.ncbi.nlm.nih.gov/pubmed/35478844 http://dx.doi.org/10.3389/fnins.2022.775457 |
work_keys_str_mv | AT kimdaehyun monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning AT chakrabortybiswadeep monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning AT shexueyuan monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning AT leeedward monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning AT kangbeomseok monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning AT mukhopadhyaysaibal monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning |