Cargando…
Event Camera Simulator Improvements via Characterized Parameters
It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8353146/ https://www.ncbi.nlm.nih.gov/pubmed/34385903 http://dx.doi.org/10.3389/fnins.2021.702765 |
_version_ | 1783736341976055808 |
---|---|
author | Joubert, Damien Marcireau, Alexandre Ralph, Nic Jolley, Andrew van Schaik, André Cohen, Gregory |
author_facet | Joubert, Damien Marcireau, Alexandre Ralph, Nic Jolley, Andrew van Schaik, André Cohen, Gregory |
author_sort | Joubert, Damien |
collection | PubMed |
description | It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed. |
format | Online Article Text |
id | pubmed-8353146 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-83531462021-08-11 Event Camera Simulator Improvements via Characterized Parameters Joubert, Damien Marcireau, Alexandre Ralph, Nic Jolley, Andrew van Schaik, André Cohen, Gregory Front Neurosci Neuroscience It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed. Frontiers Media S.A. 2021-07-27 /pmc/articles/PMC8353146/ /pubmed/34385903 http://dx.doi.org/10.3389/fnins.2021.702765 Text en Copyright © 2021 Joubert, Marcireau, Ralph, Jolley, van Schaik and Cohen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Joubert, Damien Marcireau, Alexandre Ralph, Nic Jolley, Andrew van Schaik, André Cohen, Gregory Event Camera Simulator Improvements via Characterized Parameters |
title | Event Camera Simulator Improvements via Characterized Parameters |
title_full | Event Camera Simulator Improvements via Characterized Parameters |
title_fullStr | Event Camera Simulator Improvements via Characterized Parameters |
title_full_unstemmed | Event Camera Simulator Improvements via Characterized Parameters |
title_short | Event Camera Simulator Improvements via Characterized Parameters |
title_sort | event camera simulator improvements via characterized parameters |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8353146/ https://www.ncbi.nlm.nih.gov/pubmed/34385903 http://dx.doi.org/10.3389/fnins.2021.702765 |
work_keys_str_mv | AT joubertdamien eventcamerasimulatorimprovementsviacharacterizedparameters AT marcireaualexandre eventcamerasimulatorimprovementsviacharacterizedparameters AT ralphnic eventcamerasimulatorimprovementsviacharacterizedparameters AT jolleyandrew eventcamerasimulatorimprovementsviacharacterizedparameters AT vanschaikandre eventcamerasimulatorimprovementsviacharacterizedparameters AT cohengregory eventcamerasimulatorimprovementsviacharacterizedparameters |