Cargando…
First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures
Spiking neural networks (SNNs) are well-suited to process asynchronous event-based data. Most of the existing SNNs use rate-coding schemes that focus on firing rate (FR), and so they generally ignore the spike timing in events. On the contrary, methods based on temporal coding, particularly time-to-...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10577212/ https://www.ncbi.nlm.nih.gov/pubmed/37849889 http://dx.doi.org/10.3389/fnins.2023.1266003 |
_version_ | 1785121276752297984 |
---|---|
author | Liu, Siying Leung, Vincent C. H. Dragotti, Pier Luigi |
author_facet | Liu, Siying Leung, Vincent C. H. Dragotti, Pier Luigi |
author_sort | Liu, Siying |
collection | PubMed |
description | Spiking neural networks (SNNs) are well-suited to process asynchronous event-based data. Most of the existing SNNs use rate-coding schemes that focus on firing rate (FR), and so they generally ignore the spike timing in events. On the contrary, methods based on temporal coding, particularly time-to-first-spike (TTFS) coding, can be accurate and efficient but they are difficult to train. Currently, there is limited research on applying TTFS coding to real events, since traditional TTFS-based methods impose one-spike constraint, which is not realistic for event-based data. In this study, we present a novel decision-making strategy based on first-spike (FS) coding that encodes FS timings of the output neurons to investigate the role of the first-spike timing in classifying real-world event sequences with complex temporal structures. To achieve FS coding, we propose a novel surrogate gradient learning method for discrete spike trains. In the forward pass, output spikes are encoded into discrete times to generate FS times. In the backpropagation, we develop an error assignment method that propagates error from FS times to spikes through a Gaussian window, and then supervised learning for spikes is implemented through a surrogate gradient approach. Additional strategies are introduced to facilitate the training of FS timings, such as adding empty sequences and employing different parameters for different layers. We make a comprehensive comparison between FS and FR coding in the experiments. Our results show that FS coding achieves comparable accuracy to FR coding while leading to superior energy efficiency and distinct neuronal dynamics on data sequences with very rich temporal structures. Additionally, a longer time delay in the first spike leads to higher accuracy, indicating important information is encoded in the timing of the first spike. |
format | Online Article Text |
id | pubmed-10577212 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-105772122023-10-17 First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures Liu, Siying Leung, Vincent C. H. Dragotti, Pier Luigi Front Neurosci Neuroscience Spiking neural networks (SNNs) are well-suited to process asynchronous event-based data. Most of the existing SNNs use rate-coding schemes that focus on firing rate (FR), and so they generally ignore the spike timing in events. On the contrary, methods based on temporal coding, particularly time-to-first-spike (TTFS) coding, can be accurate and efficient but they are difficult to train. Currently, there is limited research on applying TTFS coding to real events, since traditional TTFS-based methods impose one-spike constraint, which is not realistic for event-based data. In this study, we present a novel decision-making strategy based on first-spike (FS) coding that encodes FS timings of the output neurons to investigate the role of the first-spike timing in classifying real-world event sequences with complex temporal structures. To achieve FS coding, we propose a novel surrogate gradient learning method for discrete spike trains. In the forward pass, output spikes are encoded into discrete times to generate FS times. In the backpropagation, we develop an error assignment method that propagates error from FS times to spikes through a Gaussian window, and then supervised learning for spikes is implemented through a surrogate gradient approach. Additional strategies are introduced to facilitate the training of FS timings, such as adding empty sequences and employing different parameters for different layers. We make a comprehensive comparison between FS and FR coding in the experiments. Our results show that FS coding achieves comparable accuracy to FR coding while leading to superior energy efficiency and distinct neuronal dynamics on data sequences with very rich temporal structures. Additionally, a longer time delay in the first spike leads to higher accuracy, indicating important information is encoded in the timing of the first spike. Frontiers Media S.A. 2023-10-02 /pmc/articles/PMC10577212/ /pubmed/37849889 http://dx.doi.org/10.3389/fnins.2023.1266003 Text en Copyright © 2023 Liu, Leung and Dragotti. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Liu, Siying Leung, Vincent C. H. Dragotti, Pier Luigi First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title | First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title_full | First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title_fullStr | First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title_full_unstemmed | First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title_short | First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
title_sort | first-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10577212/ https://www.ncbi.nlm.nih.gov/pubmed/37849889 http://dx.doi.org/10.3389/fnins.2023.1266003 |
work_keys_str_mv | AT liusiying firstspikecodingpromotesaccurateandefficientspikingneuralnetworksfordiscreteeventswithrichtemporalstructures AT leungvincentch firstspikecodingpromotesaccurateandefficientspikingneuralnetworksfordiscreteeventswithrichtemporalstructures AT dragottipierluigi firstspikecodingpromotesaccurateandefficientspikingneuralnetworksfordiscreteeventswithrichtemporalstructures |