Cargando…

Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network

Dexterous manipulation in robotic hands relies on an accurate sense of artificial touch. Here we investigate neuromorphic tactile sensation with an event-based optical tactile sensor combined with spiking neural networks for edge orientation detection. The sensor incorporates an event-based vision s...

Descripción completa

Detalles Bibliográficos
Autores principales: Macdonald, Fraser L. A., Lepora, Nathan F., Conradt, Jörg, Ward-Cherrier, Benjamin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9500632/
https://www.ncbi.nlm.nih.gov/pubmed/36146344
http://dx.doi.org/10.3390/s22186998
_version_ 1784795268035641344
author Macdonald, Fraser L. A.
Lepora, Nathan F.
Conradt, Jörg
Ward-Cherrier, Benjamin
author_facet Macdonald, Fraser L. A.
Lepora, Nathan F.
Conradt, Jörg
Ward-Cherrier, Benjamin
author_sort Macdonald, Fraser L. A.
collection PubMed
description Dexterous manipulation in robotic hands relies on an accurate sense of artificial touch. Here we investigate neuromorphic tactile sensation with an event-based optical tactile sensor combined with spiking neural networks for edge orientation detection. The sensor incorporates an event-based vision system (mini-eDVS) into a low-form factor artificial fingertip (the NeuroTac). The processing of tactile information is performed through a Spiking Neural Network with unsupervised Spike-Timing-Dependent Plasticity (STDP) learning, and the resultant output is classified with a 3-nearest neighbours classifier. Edge orientations were classified in 10-degree increments while tapping vertically downward and sliding horizontally across the edge. In both cases, we demonstrate that the sensor is able to reliably detect edge orientation, and could lead to accurate, bio-inspired, tactile processing in robotics and prosthetics applications.
format Online
Article
Text
id pubmed-9500632
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95006322022-09-24 Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network Macdonald, Fraser L. A. Lepora, Nathan F. Conradt, Jörg Ward-Cherrier, Benjamin Sensors (Basel) Article Dexterous manipulation in robotic hands relies on an accurate sense of artificial touch. Here we investigate neuromorphic tactile sensation with an event-based optical tactile sensor combined with spiking neural networks for edge orientation detection. The sensor incorporates an event-based vision system (mini-eDVS) into a low-form factor artificial fingertip (the NeuroTac). The processing of tactile information is performed through a Spiking Neural Network with unsupervised Spike-Timing-Dependent Plasticity (STDP) learning, and the resultant output is classified with a 3-nearest neighbours classifier. Edge orientations were classified in 10-degree increments while tapping vertically downward and sliding horizontally across the edge. In both cases, we demonstrate that the sensor is able to reliably detect edge orientation, and could lead to accurate, bio-inspired, tactile processing in robotics and prosthetics applications. MDPI 2022-09-15 /pmc/articles/PMC9500632/ /pubmed/36146344 http://dx.doi.org/10.3390/s22186998 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Macdonald, Fraser L. A.
Lepora, Nathan F.
Conradt, Jörg
Ward-Cherrier, Benjamin
Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title_full Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title_fullStr Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title_full_unstemmed Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title_short Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network
title_sort neuromorphic tactile edge orientation classification in an unsupervised spiking neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9500632/
https://www.ncbi.nlm.nih.gov/pubmed/36146344
http://dx.doi.org/10.3390/s22186998
work_keys_str_mv AT macdonaldfraserla neuromorphictactileedgeorientationclassificationinanunsupervisedspikingneuralnetwork
AT leporanathanf neuromorphictactileedgeorientationclassificationinanunsupervisedspikingneuralnetwork
AT conradtjorg neuromorphictactileedgeorientationclassificationinanunsupervisedspikingneuralnetwork
AT wardcherrierbenjamin neuromorphictactileedgeorientationclassificationinanunsupervisedspikingneuralnetwork