Cargando…

MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning

We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Daehyun, Chakraborty, Biswadeep, She, Xueyuan, Lee, Edward, Kang, Beomseok, Mukhopadhyay, Saibal
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9037635/
https://www.ncbi.nlm.nih.gov/pubmed/35478844
http://dx.doi.org/10.3389/fnins.2022.775457
_version_ 1784693763676831744
author Kim, Daehyun
Chakraborty, Biswadeep
She, Xueyuan
Lee, Edward
Kang, Beomseok
Mukhopadhyay, Saibal
author_facet Kim, Daehyun
Chakraborty, Biswadeep
She, Xueyuan
Lee, Edward
Kang, Beomseok
Mukhopadhyay, Saibal
author_sort Kim, Daehyun
collection PubMed
description We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented with spike-time-dependent-plasticity (STDP) based weight update. The spiking neural network (SNN)-focused data flow is presented to minimize data movement in MONETAwhile ensuring learning accuracy. MONETAsupports on-line and on-chip training on PIM architecture. The STDP-trained convolutional neural network within SNN (ConvSNN) with the proposed data flow, 4-bit input precision, and 8-bit weight precision shows only 1.63% lower accuracy in CIFAR-10 compared to the STDP accuracy implemented by the software. Further, the proposed architecture is used to accelerate a hybrid SNN architecture that couples off-chip supervised (back propagation through time) and on-chip unsupervised (STDP) training. We also evaluate the hybrid network architecture with the proposed data flow. The accuracy of this hybrid network is 10.84% higher than STDP trained accuracy result and 1.4% higher compared to the backpropagated training-based ConvSNN result with the CIFAR-10 dataset. Physical design of MONETAin 65 nm complementary metal-oxide-semiconductor (CMOS) shows 18.69 tera operation per second (TOPS)/W, 7.25 TOPS/W and 10.41 TOPS/W power efficiencies for the inference mode, learning mode, and hybrid learning mode, respectively.
format Online
Article
Text
id pubmed-9037635
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-90376352022-04-26 MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning Kim, Daehyun Chakraborty, Biswadeep She, Xueyuan Lee, Edward Kang, Beomseok Mukhopadhyay, Saibal Front Neurosci Neuroscience We present a processing-in-memory (PIM)-based hardware platform, referred to as MONETA, for on-chip acceleration of inference and learning in hybrid convolutional spiking neural network. MONETAuses 8T static random-access memory (SRAM)-based PIM cores for vector matrix multiplication (VMM) augmented with spike-time-dependent-plasticity (STDP) based weight update. The spiking neural network (SNN)-focused data flow is presented to minimize data movement in MONETAwhile ensuring learning accuracy. MONETAsupports on-line and on-chip training on PIM architecture. The STDP-trained convolutional neural network within SNN (ConvSNN) with the proposed data flow, 4-bit input precision, and 8-bit weight precision shows only 1.63% lower accuracy in CIFAR-10 compared to the STDP accuracy implemented by the software. Further, the proposed architecture is used to accelerate a hybrid SNN architecture that couples off-chip supervised (back propagation through time) and on-chip unsupervised (STDP) training. We also evaluate the hybrid network architecture with the proposed data flow. The accuracy of this hybrid network is 10.84% higher than STDP trained accuracy result and 1.4% higher compared to the backpropagated training-based ConvSNN result with the CIFAR-10 dataset. Physical design of MONETAin 65 nm complementary metal-oxide-semiconductor (CMOS) shows 18.69 tera operation per second (TOPS)/W, 7.25 TOPS/W and 10.41 TOPS/W power efficiencies for the inference mode, learning mode, and hybrid learning mode, respectively. Frontiers Media S.A. 2022-04-11 /pmc/articles/PMC9037635/ /pubmed/35478844 http://dx.doi.org/10.3389/fnins.2022.775457 Text en Copyright © 2022 Kim, Chakraborty, She, Lee, Kang and Mukhopadhyay. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Kim, Daehyun
Chakraborty, Biswadeep
She, Xueyuan
Lee, Edward
Kang, Beomseok
Mukhopadhyay, Saibal
MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title_full MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title_fullStr MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title_full_unstemmed MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title_short MONETA: A Processing-In-Memory-Based Hardware Platform for the Hybrid Convolutional Spiking Neural Network With Online Learning
title_sort moneta: a processing-in-memory-based hardware platform for the hybrid convolutional spiking neural network with online learning
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9037635/
https://www.ncbi.nlm.nih.gov/pubmed/35478844
http://dx.doi.org/10.3389/fnins.2022.775457
work_keys_str_mv AT kimdaehyun monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning
AT chakrabortybiswadeep monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning
AT shexueyuan monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning
AT leeedward monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning
AT kangbeomseok monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning
AT mukhopadhyaysaibal monetaaprocessinginmemorybasedhardwareplatformforthehybridconvolutionalspikingneuralnetworkwithonlinelearning