Cargando…
American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network
This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vi...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5677181/ https://www.ncbi.nlm.nih.gov/pubmed/28937644 http://dx.doi.org/10.3390/s17102176 |
_version_ | 1783277191665025024 |
---|---|
author | Rivera-Acosta, Miguel Ortega-Cisneros, Susana Rivera, Jorge Sandoval-Ibarra, Federico |
author_facet | Rivera-Acosta, Miguel Ortega-Cisneros, Susana Rivera, Jorge Sandoval-Ibarra, Federico |
author_sort | Rivera-Acosta, Miguel |
collection | PubMed |
description | This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vision Sensor, DVS) sensor using the Universal Serial Bus protocol. The feature extraction of the events generated by the DVS is the second part of the process, consisting of a presentation of the digital image processing algorithms developed in software, which aim to reduce redundant information and prepare the data for the third stage. The last stage of the system process is the classification of the ASL alphabet, achieved with a single artificial neural network implemented in digital hardware for higher speed. The overall result is the development of a classification system using the ASL signs contour, fully implemented in a reconfigurable device. The experimental results consist of a comparative analysis of the recognition rate among the alphabet signs using the neuromorphic camera in order to prove the proper operation of the digital image processing algorithms. In the experiments performed with 720 samples of 24 signs, a recognition accuracy of 79.58% was obtained. |
format | Online Article Text |
id | pubmed-5677181 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-56771812017-11-17 American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network Rivera-Acosta, Miguel Ortega-Cisneros, Susana Rivera, Jorge Sandoval-Ibarra, Federico Sensors (Basel) Article This paper reports the design and analysis of an American Sign Language (ASL) alphabet translation system implemented in hardware using a Field-Programmable Gate Array. The system process consists of three stages, the first being the communication with the neuromorphic camera (also called Dynamic Vision Sensor, DVS) sensor using the Universal Serial Bus protocol. The feature extraction of the events generated by the DVS is the second part of the process, consisting of a presentation of the digital image processing algorithms developed in software, which aim to reduce redundant information and prepare the data for the third stage. The last stage of the system process is the classification of the ASL alphabet, achieved with a single artificial neural network implemented in digital hardware for higher speed. The overall result is the development of a classification system using the ASL signs contour, fully implemented in a reconfigurable device. The experimental results consist of a comparative analysis of the recognition rate among the alphabet signs using the neuromorphic camera in order to prove the proper operation of the digital image processing algorithms. In the experiments performed with 720 samples of 24 signs, a recognition accuracy of 79.58% was obtained. MDPI 2017-09-22 /pmc/articles/PMC5677181/ /pubmed/28937644 http://dx.doi.org/10.3390/s17102176 Text en © 2017 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Rivera-Acosta, Miguel Ortega-Cisneros, Susana Rivera, Jorge Sandoval-Ibarra, Federico American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title | American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title_full | American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title_fullStr | American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title_full_unstemmed | American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title_short | American Sign Language Alphabet Recognition Using a Neuromorphic Sensor and an Artificial Neural Network |
title_sort | american sign language alphabet recognition using a neuromorphic sensor and an artificial neural network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5677181/ https://www.ncbi.nlm.nih.gov/pubmed/28937644 http://dx.doi.org/10.3390/s17102176 |
work_keys_str_mv | AT riveraacostamiguel americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork AT ortegacisnerossusana americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork AT riverajorge americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork AT sandovalibarrafederico americansignlanguagealphabetrecognitionusinganeuromorphicsensorandanartificialneuralnetwork |