Cargando…
Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics
Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actua...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7512993/ https://www.ncbi.nlm.nih.gov/pubmed/33265565 http://dx.doi.org/10.3390/e20060475 |
_version_ | 1783586285579927552 |
---|---|
author | Linares-Barranco, Alejandro Liu, Hongjie Rios-Navarro, Antonio Gomez-Rodriguez, Francisco Moeys, Diederik P. Delbruck, Tobi |
author_facet | Linares-Barranco, Alejandro Liu, Hongjie Rios-Navarro, Antonio Gomez-Rodriguez, Francisco Moeys, Diederik P. Delbruck, Tobi |
author_sort | Linares-Barranco, Alejandro |
collection | PubMed |
description | Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actuators. This paper is focused on mimicking the approaching detection functionality of the retina that is computed by one type of Retinal Ganglion Cell (RGC) and its application to robotics. These RGCs transmit action potentials when an expanding object is detected. In this work we compare the software and hardware logic FPGA implementations of this approaching function and the hardware latency when applied to robots, as an attention/reaction mechanism. The visual input for these cells comes from an asynchronous event-driven Dynamic Vision Sensor, which leads to an end-to-end event based processing system. The software model has been developed in Java, and computed with an average processing time per event of 370 ns on a NUC embedded computer. The output firing rate for an approaching object depends on the cell parameters that represent the needed number of input events to reach the firing threshold. For the hardware implementation, on a Spartan 6 FPGA, the processing time is reduced to 160 ns/event with the clock running at 50 MHz. The entropy has been calculated to demonstrate that the system is not totally deterministic in response to approaching objects because of several bioinspired characteristics. It has been measured that a Summit XL mobile robot can react to an approaching object in 90 ms, which can be used as an attentional mechanism. This is faster than similar event-based approaches in robotics and equivalent to human reaction latencies to visual stimulus. |
format | Online Article Text |
id | pubmed-7512993 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-75129932020-11-09 Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics Linares-Barranco, Alejandro Liu, Hongjie Rios-Navarro, Antonio Gomez-Rodriguez, Francisco Moeys, Diederik P. Delbruck, Tobi Entropy (Basel) Article Taking inspiration from biology to solve engineering problems using the organizing principles of biological neural computation is the aim of the field of neuromorphic engineering. This field has demonstrated success in sensor based applications (vision and audition) as well as in cognition and actuators. This paper is focused on mimicking the approaching detection functionality of the retina that is computed by one type of Retinal Ganglion Cell (RGC) and its application to robotics. These RGCs transmit action potentials when an expanding object is detected. In this work we compare the software and hardware logic FPGA implementations of this approaching function and the hardware latency when applied to robots, as an attention/reaction mechanism. The visual input for these cells comes from an asynchronous event-driven Dynamic Vision Sensor, which leads to an end-to-end event based processing system. The software model has been developed in Java, and computed with an average processing time per event of 370 ns on a NUC embedded computer. The output firing rate for an approaching object depends on the cell parameters that represent the needed number of input events to reach the firing threshold. For the hardware implementation, on a Spartan 6 FPGA, the processing time is reduced to 160 ns/event with the clock running at 50 MHz. The entropy has been calculated to demonstrate that the system is not totally deterministic in response to approaching objects because of several bioinspired characteristics. It has been measured that a Summit XL mobile robot can react to an approaching object in 90 ms, which can be used as an attentional mechanism. This is faster than similar event-based approaches in robotics and equivalent to human reaction latencies to visual stimulus. MDPI 2018-06-19 /pmc/articles/PMC7512993/ /pubmed/33265565 http://dx.doi.org/10.3390/e20060475 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Linares-Barranco, Alejandro Liu, Hongjie Rios-Navarro, Antonio Gomez-Rodriguez, Francisco Moeys, Diederik P. Delbruck, Tobi Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title | Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title_full | Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title_fullStr | Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title_full_unstemmed | Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title_short | Approaching Retinal Ganglion Cell Modeling and FPGA Implementation for Robotics |
title_sort | approaching retinal ganglion cell modeling and fpga implementation for robotics |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7512993/ https://www.ncbi.nlm.nih.gov/pubmed/33265565 http://dx.doi.org/10.3390/e20060475 |
work_keys_str_mv | AT linaresbarrancoalejandro approachingretinalganglioncellmodelingandfpgaimplementationforrobotics AT liuhongjie approachingretinalganglioncellmodelingandfpgaimplementationforrobotics AT riosnavarroantonio approachingretinalganglioncellmodelingandfpgaimplementationforrobotics AT gomezrodriguezfrancisco approachingretinalganglioncellmodelingandfpgaimplementationforrobotics AT moeysdiederikp approachingretinalganglioncellmodelingandfpgaimplementationforrobotics AT delbrucktobi approachingretinalganglioncellmodelingandfpgaimplementationforrobotics |