Cargando…
Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task
Spiking Neural Networks (SNNs), known for their potential to enable low energy consumption and computational cost, can bring significant advantages to the realm of embedded machine learning for edge applications. However, input coming from standard digital sensors must be encoded into spike trains b...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811205/ https://www.ncbi.nlm.nih.gov/pubmed/36620463 http://dx.doi.org/10.3389/fnins.2022.999029 |
_version_ | 1784863481311264768 |
---|---|
author | Forno, Evelina Fra, Vittorio Pignari, Riccardo Macii, Enrico Urgese, Gianvito |
author_facet | Forno, Evelina Fra, Vittorio Pignari, Riccardo Macii, Enrico Urgese, Gianvito |
author_sort | Forno, Evelina |
collection | PubMed |
description | Spiking Neural Networks (SNNs), known for their potential to enable low energy consumption and computational cost, can bring significant advantages to the realm of embedded machine learning for edge applications. However, input coming from standard digital sensors must be encoded into spike trains before it can be elaborated with neuromorphic computing technologies. We present here a detailed comparison of available spike encoding techniques for the translation of time-varying signals into the event-based signal domain, tested on two different datasets both acquired through commercially available digital devices: the Free Spoken Digit dataset (FSD), consisting of 8-kHz audio files, and the WISDM dataset, composed of 20-Hz recordings of human activity through mobile and wearable inertial sensors. We propose a complete pipeline to benchmark these encoding techniques by performing time-dependent signal classification through a Spiking Convolutional Neural Network (sCNN), including a signal preprocessing step consisting of a bank of filters inspired by the human cochlea, feature extraction by production of a sonogram, transfer learning via an equivalent ANN, and model compression schemes aimed at resource optimization. The resulting performance comparison and analysis provides a powerful practical tool, empowering developers to select the most suitable coding method based on the type of data and the desired processing algorithms, and further expands the applicability of neuromorphic computational paradigms to embedded sensor systems widely employed in the IoT and industrial domains. |
format | Online Article Text |
id | pubmed-9811205 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98112052023-01-05 Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task Forno, Evelina Fra, Vittorio Pignari, Riccardo Macii, Enrico Urgese, Gianvito Front Neurosci Neuroscience Spiking Neural Networks (SNNs), known for their potential to enable low energy consumption and computational cost, can bring significant advantages to the realm of embedded machine learning for edge applications. However, input coming from standard digital sensors must be encoded into spike trains before it can be elaborated with neuromorphic computing technologies. We present here a detailed comparison of available spike encoding techniques for the translation of time-varying signals into the event-based signal domain, tested on two different datasets both acquired through commercially available digital devices: the Free Spoken Digit dataset (FSD), consisting of 8-kHz audio files, and the WISDM dataset, composed of 20-Hz recordings of human activity through mobile and wearable inertial sensors. We propose a complete pipeline to benchmark these encoding techniques by performing time-dependent signal classification through a Spiking Convolutional Neural Network (sCNN), including a signal preprocessing step consisting of a bank of filters inspired by the human cochlea, feature extraction by production of a sonogram, transfer learning via an equivalent ANN, and model compression schemes aimed at resource optimization. The resulting performance comparison and analysis provides a powerful practical tool, empowering developers to select the most suitable coding method based on the type of data and the desired processing algorithms, and further expands the applicability of neuromorphic computational paradigms to embedded sensor systems widely employed in the IoT and industrial domains. Frontiers Media S.A. 2022-12-21 /pmc/articles/PMC9811205/ /pubmed/36620463 http://dx.doi.org/10.3389/fnins.2022.999029 Text en Copyright © 2022 Forno, Fra, Pignari, Macii and Urgese. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Forno, Evelina Fra, Vittorio Pignari, Riccardo Macii, Enrico Urgese, Gianvito Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title | Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title_full | Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title_fullStr | Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title_full_unstemmed | Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title_short | Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task |
title_sort | spike encoding techniques for iot time-varying signals benchmarked on a neuromorphic classification task |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811205/ https://www.ncbi.nlm.nih.gov/pubmed/36620463 http://dx.doi.org/10.3389/fnins.2022.999029 |
work_keys_str_mv | AT fornoevelina spikeencodingtechniquesforiottimevaryingsignalsbenchmarkedonaneuromorphicclassificationtask AT fravittorio spikeencodingtechniquesforiottimevaryingsignalsbenchmarkedonaneuromorphicclassificationtask AT pignaririccardo spikeencodingtechniquesforiottimevaryingsignalsbenchmarkedonaneuromorphicclassificationtask AT maciienrico spikeencodingtechniquesforiottimevaryingsignalsbenchmarkedonaneuromorphicclassificationtask AT urgesegianvito spikeencodingtechniquesforiottimevaryingsignalsbenchmarkedonaneuromorphicclassificationtask |