Cargando…
Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing
With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8766965/ https://www.ncbi.nlm.nih.gov/pubmed/35069101 http://dx.doi.org/10.3389/fnins.2021.781786 |
_version_ | 1784634623107530752 |
---|---|
author | Parmar, Vivek Penkovsky, Bogdan Querlioz, Damien Suri, Manan |
author_facet | Parmar, Vivek Penkovsky, Bogdan Querlioz, Damien Suri, Manan |
author_sort | Parmar, Vivek |
collection | PubMed |
description | With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a challenge in deploying a uniform hardware mapping for the network implementation. Stochastic computing can allow conversion of such high-precision computations to a sequence of binarized operations while maintaining equivalent accuracy. In this work, we propose a fully binarized hardware-friendly computation engine based on stochastic computing as a proof of concept for vision applications involving multi-channel inputs. Stochastic sampling is performed by sampling from a non-uniform (normal) distribution based on analog hardware sources. We first validate the benefits of the proposed pipeline on the CIFAR-10 dataset. To further demonstrate its application for real-world scenarios, we present a case-study of microscopy image diagnostics for pathogen detection. We then evaluate benefits of implementing such a pipeline using OxRAM-based circuits for stochastic sampling as well as in-memory computing-based binarized multiplication. The proposed implementation is about 1,000 times more energy efficient compared to conventional floating-precision-based digital implementations, with memory savings of a factor of 45. |
format | Online Article Text |
id | pubmed-8766965 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-87669652022-01-20 Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing Parmar, Vivek Penkovsky, Bogdan Querlioz, Damien Suri, Manan Front Neurosci Neuroscience With recent advances in the field of artificial intelligence (AI) such as binarized neural networks (BNNs), a wide variety of vision applications with energy-optimized implementations have become possible at the edge. Such networks have the first layer implemented with high precision, which poses a challenge in deploying a uniform hardware mapping for the network implementation. Stochastic computing can allow conversion of such high-precision computations to a sequence of binarized operations while maintaining equivalent accuracy. In this work, we propose a fully binarized hardware-friendly computation engine based on stochastic computing as a proof of concept for vision applications involving multi-channel inputs. Stochastic sampling is performed by sampling from a non-uniform (normal) distribution based on analog hardware sources. We first validate the benefits of the proposed pipeline on the CIFAR-10 dataset. To further demonstrate its application for real-world scenarios, we present a case-study of microscopy image diagnostics for pathogen detection. We then evaluate benefits of implementing such a pipeline using OxRAM-based circuits for stochastic sampling as well as in-memory computing-based binarized multiplication. The proposed implementation is about 1,000 times more energy efficient compared to conventional floating-precision-based digital implementations, with memory savings of a factor of 45. Frontiers Media S.A. 2022-01-05 /pmc/articles/PMC8766965/ /pubmed/35069101 http://dx.doi.org/10.3389/fnins.2021.781786 Text en Copyright © 2022 Parmar, Penkovsky, Querlioz and Suri. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Parmar, Vivek Penkovsky, Bogdan Querlioz, Damien Suri, Manan Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title | Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title_full | Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title_fullStr | Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title_full_unstemmed | Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title_short | Hardware-Efficient Stochastic Binary CNN Architectures for Near-Sensor Computing |
title_sort | hardware-efficient stochastic binary cnn architectures for near-sensor computing |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8766965/ https://www.ncbi.nlm.nih.gov/pubmed/35069101 http://dx.doi.org/10.3389/fnins.2021.781786 |
work_keys_str_mv | AT parmarvivek hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing AT penkovskybogdan hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing AT querliozdamien hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing AT surimanan hardwareefficientstochasticbinarycnnarchitecturesfornearsensorcomputing |