Cargando…
Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands
Nowadays, daily life involves the extensive use of computers, since human beings are immersed in a technological society. Therefore, it is mandatory to interact with computers, which represents a true disadvantage for people with upper limb disabilities. In this context, this work aims to develop an...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735627/ https://www.ncbi.nlm.nih.gov/pubmed/36501980 http://dx.doi.org/10.3390/s22239279 |
_version_ | 1784846816599080960 |
---|---|
author | Ramos, Pablo Zapata, Mireya Valencia, Kevin Vargas, Vanessa Ramos-Galarza, Carlos |
author_facet | Ramos, Pablo Zapata, Mireya Valencia, Kevin Vargas, Vanessa Ramos-Galarza, Carlos |
author_sort | Ramos, Pablo |
collection | PubMed |
description | Nowadays, daily life involves the extensive use of computers, since human beings are immersed in a technological society. Therefore, it is mandatory to interact with computers, which represents a true disadvantage for people with upper limb disabilities. In this context, this work aims to develop an interface for emulating mouse and keyboard functions (EMKEY) by applying concepts of artificial vision and voice recognition to replace the use of hands. Pointer control is achieved by head movement, whereas voice recognition is used to perform interface functionalities, including speech-to-text transcription. To evaluate the interface’s usability and usefulness, two studies were carried out. The first study was performed with 30 participants without physical disabilities. Throughout this study, there were significant correlations found between the emulator’s usability and aspects such as adaptability, execution time, and the participant’s age. In the second study, the use of the emulator was analyzed by four participants with motor disabilities. It was found that the interface was best used by the participant with cerebral palsy, followed by the participants with upper limb paralysis, spina bifida, and muscular dystrophy. In general, the results show that the proposed interface is easy to use, practical, fairly accurate, and works on a wide range of computers. |
format | Online Article Text |
id | pubmed-9735627 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-97356272022-12-11 Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands Ramos, Pablo Zapata, Mireya Valencia, Kevin Vargas, Vanessa Ramos-Galarza, Carlos Sensors (Basel) Article Nowadays, daily life involves the extensive use of computers, since human beings are immersed in a technological society. Therefore, it is mandatory to interact with computers, which represents a true disadvantage for people with upper limb disabilities. In this context, this work aims to develop an interface for emulating mouse and keyboard functions (EMKEY) by applying concepts of artificial vision and voice recognition to replace the use of hands. Pointer control is achieved by head movement, whereas voice recognition is used to perform interface functionalities, including speech-to-text transcription. To evaluate the interface’s usability and usefulness, two studies were carried out. The first study was performed with 30 participants without physical disabilities. Throughout this study, there were significant correlations found between the emulator’s usability and aspects such as adaptability, execution time, and the participant’s age. In the second study, the use of the emulator was analyzed by four participants with motor disabilities. It was found that the interface was best used by the participant with cerebral palsy, followed by the participants with upper limb paralysis, spina bifida, and muscular dystrophy. In general, the results show that the proposed interface is easy to use, practical, fairly accurate, and works on a wide range of computers. MDPI 2022-11-29 /pmc/articles/PMC9735627/ /pubmed/36501980 http://dx.doi.org/10.3390/s22239279 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ramos, Pablo Zapata, Mireya Valencia, Kevin Vargas, Vanessa Ramos-Galarza, Carlos Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title | Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title_full | Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title_fullStr | Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title_full_unstemmed | Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title_short | Low-Cost Human–Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands |
title_sort | low-cost human–machine interface for computer control with facial landmark detection and voice commands |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735627/ https://www.ncbi.nlm.nih.gov/pubmed/36501980 http://dx.doi.org/10.3390/s22239279 |
work_keys_str_mv | AT ramospablo lowcosthumanmachineinterfaceforcomputercontrolwithfaciallandmarkdetectionandvoicecommands AT zapatamireya lowcosthumanmachineinterfaceforcomputercontrolwithfaciallandmarkdetectionandvoicecommands AT valenciakevin lowcosthumanmachineinterfaceforcomputercontrolwithfaciallandmarkdetectionandvoicecommands AT vargasvanessa lowcosthumanmachineinterfaceforcomputercontrolwithfaciallandmarkdetectionandvoicecommands AT ramosgalarzacarlos lowcosthumanmachineinterfaceforcomputercontrolwithfaciallandmarkdetectionandvoicecommands |