Cargando…

Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics

Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actua...

Descripción completa

Detalles Bibliográficos
Autores principales: Linares-Barranco, Alejandro, Liu, Hongjie, Rios-Navarro, Antonio, Gomez-Rodriguez, Francisco, Moeys, Diederik P., Delbruck, Tobi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7512993/
https://www.ncbi.nlm.nih.gov/pubmed/33265565
http://dx.doi.org/10.3390/e20060475
_version_ 1783586285579927552
author Linares-Barranco, Alejandro
Liu, Hongjie
Rios-Navarro, Antonio
Gomez-Rodriguez, Francisco
Moeys, Diederik P.
Delbruck, Tobi
author_facet Linares-Barranco, Alejandro
Liu, Hongjie
Rios-Navarro, Antonio
Gomez-Rodriguez, Francisco
Moeys, Diederik P.
Delbruck, Tobi
author_sort Linares-Barranco, Alejandro
collection PubMed
description Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actuators. This paper is focused on mimicking the approaching detection functionality of the retina that is computed by one type of Retinal Ganglion Cell (RGC) and its application to robotics. These RGCs transmit action potentials when an expanding object is detected. In this work we compare the software and hardware logic FPGA implementations of this approaching function and the hardware latency when applied to robots, as an attention/reaction mechanism. The visual input for these cells comes from an asynchronous event-driven Dynamic Vision Sensor, which leads to an end-to-end event based processing system. The software model has been developed in Java, and computed with an average processing time per event of 370 ns on a NUC embedded computer. The output firing rate for an approaching object depends on the cell parameters that represent the needed number of input events to reach the firing threshold. For the hardware implementation, on a Spartan 6 FPGA, the processing time is reduced to 160 ns/event with the clock running at 50 MHz. The entropy has been calculated to demonstrate that the system is not totally deterministic in response to approaching objects because of several bioinspired characteristics. It has been measured that a Summit XL mobile robot can react to an approaching object in 90 ms, which can be used as an attentional mechanism. This is faster than similar event-based approaches in robotics and equivalent to human reaction latencies to visual stimulus.
format Online
Article
Text
id pubmed-7512993
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75129932020-11-09 Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics Linares-Barranco, Alejandro Liu, Hongjie Rios-Navarro, Antonio Gomez-Rodriguez, Francisco Moeys, Diederik P. Delbruck, Tobi Entropy (Basel) Article Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actuators. This paper is focused on mimicking the approaching detection functionality of the retina that is computed by one type of Retinal Ganglion Cell (RGC) and its application to robotics. These RGCs transmit action potentials when an expanding object is detected. In this work we compare the software and hardware logic FPGA implementations of this approaching function and the hardware latency when applied to robots, as an attention/reaction mechanism. The visual input for these cells comes from an asynchronous event-driven Dynamic Vision Sensor, which leads to an end-to-end event based processing system. The software model has been developed in Java, and computed with an average processing time per event of 370 ns on a NUC embedded computer. The output firing rate for an approaching object depends on the cell parameters that represent the needed number of input events to reach the firing threshold. For the hardware implementation, on a Spartan 6 FPGA, the processing time is reduced to 160 ns/event with the clock running at 50 MHz. The entropy has been calculated to demonstrate that the system is not totally deterministic in response to approaching objects because of several bioinspired characteristics. It has been measured that a Summit XL mobile robot can react to an approaching object in 90 ms, which can be used as an attentional mechanism. This is faster than similar event-based approaches in robotics and equivalent to human reaction latencies to visual stimulus. MDPI 2018-06-19 /pmc/articles/PMC7512993/ /pubmed/33265565 http://dx.doi.org/10.3390/e20060475 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Linares-Barranco, Alejandro
Liu, Hongjie
Rios-Navarro, Antonio
Gomez-Rodriguez, Francisco
Moeys, Diederik P.
Delbruck, Tobi
Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title_full Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title_fullStr Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title_full_unstemmed Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title_short Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
title_sort approaching retinal ganglion cell modeling and fpga implementation for robotics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7512993/
https://www.ncbi.nlm.nih.gov/pubmed/33265565
http://dx.doi.org/10.3390/e20060475
work_keys_str_mv AT linaresbarrancoalejandro approachingretinalganglioncellmodelingandfpgaimplementationforrobotics
AT liuhongjie approachingretinalganglioncellmodelingandfpgaimplementationforrobotics
AT riosnavarroantonio approachingretinalganglioncellmodelingandfpgaimplementationforrobotics
AT gomezrodriguezfrancisco approachingretinalganglioncellmodelingandfpgaimplementationforrobotics
AT moeysdiederikp approachingretinalganglioncellmodelingandfpgaimplementationforrobotics
AT delbrucktobi approachingretinalganglioncellmodelingandfpgaimplementationforrobotics