Cargando…

American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network

This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vi...

Descripción completa

Detalles Bibliográficos
Autores principales: Rivera-Acosta, Miguel, Ortega-Cisneros, Susana, Rivera, Jorge, Sandoval-Ibarra, Federico
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5677181/
https://www.ncbi.nlm.nih.gov/pubmed/28937644
http://dx.doi.org/10.3390/s17102176
_version_ 1783277191665025024
author Rivera-Acosta, Miguel
Ortega-Cisneros, Susana
Rivera, Jorge
Sandoval-Ibarra, Federico
author_facet Rivera-Acosta, Miguel
Ortega-Cisneros, Susana
Rivera, Jorge
Sandoval-Ibarra, Federico
author_sort Rivera-Acosta, Miguel
collection PubMed
description This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vision Sensor, DVS) sensor using the Universal Serial Bus protocol. The feature extraction of the events generated by the DVS is the second part of the process, consisting of a presentation of the digital image processing algorithms developed in software, which aim to reduce redundant information and prepare the data for the third stage. The last stage of the system process is the classification of the ASL alphabet, achieved with a single artificial neural network implemented in digital hardware for higher speed. The overall result is the development of a classification system using the ASL signs contour, fully implemented in a reconfigurable device. The experimental results consist of a comparative analysis of the recognition rate among the alphabet signs using the neuromorphic camera in order to prove the proper operation of the digital image processing algorithms. In the experiments performed with 720 samples of 24 signs, a recognition accuracy of 79.58% was obtained.
format Online
Article
Text
id pubmed-5677181
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-56771812017-11-17 American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network Rivera-Acosta, Miguel Ortega-Cisneros, Susana Rivera, Jorge Sandoval-Ibarra, Federico Sensors (Basel) Article This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vision Sensor, DVS) sensor using the Universal Serial Bus protocol. The feature extraction of the events generated by the DVS is the second part of the process, consisting of a presentation of the digital image processing algorithms developed in software, which aim to reduce redundant information and prepare the data for the third stage. The last stage of the system process is the classification of the ASL alphabet, achieved with a single artificial neural network implemented in digital hardware for higher speed. The overall result is the development of a classification system using the ASL signs contour, fully implemented in a reconfigurable device. The experimental results consist of a comparative analysis of the recognition rate among the alphabet signs using the neuromorphic camera in order to prove the proper operation of the digital image processing algorithms. In the experiments performed with 720 samples of 24 signs, a recognition accuracy of 79.58% was obtained. MDPI 2017-09-22 /pmc/articles/PMC5677181/ /pubmed/28937644 http://dx.doi.org/10.3390/s17102176 Text en © 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Rivera-Acosta, Miguel
Ortega-Cisneros, Susana
Rivera, Jorge
Sandoval-Ibarra, Federico
American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title_full American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title_fullStr American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title_full_unstemmed American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title_short American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
title_sort american sign language alphabet recognition using a neuromorphic sensor and an artificial neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5677181/
https://www.ncbi.nlm.nih.gov/pubmed/28937644
http://dx.doi.org/10.3390/s17102176
work_keys_str_mv AT riveraacostamiguel americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork
AT ortegacisnerossusana americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork
AT riverajorge americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork
AT sandovalibarrafederico americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork