Cargando…

Event Camera Simulator Improvements via Characterized Parameters

It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although...

Descripción completa

Detalles Bibliográficos
Autores principales: Joubert, Damien, Marcireau, Alexandre, Ralph, Nic, Jolley, Andrew, van Schaik, André, Cohen, Gregory
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8353146/
https://www.ncbi.nlm.nih.gov/pubmed/34385903
http://dx.doi.org/10.3389/fnins.2021.702765
_version_ 1783736341976055808
author Joubert, Damien
Marcireau, Alexandre
Ralph, Nic
Jolley, Andrew
van Schaik, André
Cohen, Gregory
author_facet Joubert, Damien
Marcireau, Alexandre
Ralph, Nic
Jolley, Andrew
van Schaik, André
Cohen, Gregory
author_sort Joubert, Damien
collection PubMed
description It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed.
format Online
Article
Text
id pubmed-8353146
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-83531462021-08-11 Event Camera Simulator Improvements via Characterized Parameters Joubert, Damien Marcireau, Alexandre Ralph, Nic Jolley, Andrew van Schaik, André Cohen, Gregory Front Neurosci Neuroscience It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed. Frontiers Media S.A. 2021-07-27 /pmc/articles/PMC8353146/ /pubmed/34385903 http://dx.doi.org/10.3389/fnins.2021.702765 Text en Copyright © 2021 Joubert, Marcireau, Ralph, Jolley, van Schaik and Cohen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Joubert, Damien
Marcireau, Alexandre
Ralph, Nic
Jolley, Andrew
van Schaik, André
Cohen, Gregory
Event Camera Simulator Improvements via Characterized Parameters
title Event Camera Simulator Improvements via Characterized Parameters
title_full Event Camera Simulator Improvements via Characterized Parameters
title_fullStr Event Camera Simulator Improvements via Characterized Parameters
title_full_unstemmed Event Camera Simulator Improvements via Characterized Parameters
title_short Event Camera Simulator Improvements via Characterized Parameters
title_sort event camera simulator improvements via characterized parameters
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8353146/
https://www.ncbi.nlm.nih.gov/pubmed/34385903
http://dx.doi.org/10.3389/fnins.2021.702765
work_keys_str_mv AT joubertdamien eventcamerasimulatorimprovementsviacharacterizedparameters
AT marcireaualexandre eventcamerasimulatorimprovementsviacharacterizedparameters
AT ralphnic eventcamerasimulatorimprovementsviacharacterizedparameters
AT jolleyandrew eventcamerasimulatorimprovementsviacharacterizedparameters
AT vanschaikandre eventcamerasimulatorimprovementsviacharacterizedparameters
AT cohengregory eventcamerasimulatorimprovementsviacharacterizedparameters