Cargando…

Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing

With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a...

Descripción completa

Detalles Bibliográficos
Autores principales: Parmar, Vivek, Penkovsky, Bogdan, Querlioz, Damien, Suri, Manan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8766965/
https://www.ncbi.nlm.nih.gov/pubmed/35069101
http://dx.doi.org/10.3389/fnins.2021.781786
_version_ 1784634623107530752
author Parmar, Vivek
Penkovsky, Bogdan
Querlioz, Damien
Suri, Manan
author_facet Parmar, Vivek
Penkovsky, Bogdan
Querlioz, Damien
Suri, Manan
author_sort Parmar, Vivek
collection PubMed
description With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a challenge in deploying a uniform hardware mapping for the network implementation. Stochastic computing can allow conversion of such high-precision computations to a sequence of binarized operations while maintaining equivalent accuracy. In this work, we propose a fully binarized hardware-friendly computation engine based on stochastic computing as a proof of concept for vision applications involving multi-channel inputs. Stochastic sampling is performed by sampling from a non-uniform (normal) distribution based on analog hardware sources. We first validate the benefits of the proposed pipeline on the CIFAR-10 dataset. To further demonstrate its application for real-world scenarios, we present a case-study of microscopy image diagnostics for pathogen detection. We then evaluate benefits of implementing such a pipeline using OxRAM-based circuits for stochastic sampling as well as in-memory computing-based binarized multiplication. The proposed implementation is about 1,000 times more energy efficient compared to conventional floating-precision-based digital implementations, with memory savings of a factor of 45.
format Online
Article
Text
id pubmed-8766965
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-87669652022-01-20 Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing Parmar, Vivek Penkovsky, Bogdan Querlioz, Damien Suri, Manan Front Neurosci Neuroscience With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a challenge in deploying a uniform hardware mapping for the network implementation. Stochastic computing can allow conversion of such high-precision computations to a sequence of binarized operations while maintaining equivalent accuracy. In this work, we propose a fully binarized hardware-friendly computation engine based on stochastic computing as a proof of concept for vision applications involving multi-channel inputs. Stochastic sampling is performed by sampling from a non-uniform (normal) distribution based on analog hardware sources. We first validate the benefits of the proposed pipeline on the CIFAR-10 dataset. To further demonstrate its application for real-world scenarios, we present a case-study of microscopy image diagnostics for pathogen detection. We then evaluate benefits of implementing such a pipeline using OxRAM-based circuits for stochastic sampling as well as in-memory computing-based binarized multiplication. The proposed implementation is about 1,000 times more energy efficient compared to conventional floating-precision-based digital implementations, with memory savings of a factor of 45. Frontiers Media S.A. 2022-01-05 /pmc/articles/PMC8766965/ /pubmed/35069101 http://dx.doi.org/10.3389/fnins.2021.781786 Text en Copyright © 2022 Parmar, Penkovsky, Querlioz and Suri. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Parmar, Vivek
Penkovsky, Bogdan
Querlioz, Damien
Suri, Manan
Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title_full Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title_fullStr Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title_full_unstemmed Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title_short Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
title_sort hardware-efficient stochastic binary cnn architectures for near-sensor computing
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8766965/
https://www.ncbi.nlm.nih.gov/pubmed/35069101
http://dx.doi.org/10.3389/fnins.2021.781786
work_keys_str_mv AT parmarvivek hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing
AT penkovskybogdan hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing
AT querliozdamien hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing
AT surimanan hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing