Cargando…
Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa
Currently, the use of voice-assistants has been on the rise, but a user-centric usability evaluation of these devices is a must for ensuring their success. System Usability Scale (SUS) is one such popular usability instrument in a Graphical User Interface (GUI) scenario. However, there are certain f...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Singapore
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7798382/ https://www.ncbi.nlm.nih.gov/pubmed/33458698 http://dx.doi.org/10.1007/s42979-020-00424-4 |
_version_ | 1783635049642459136 |
---|---|
author | Zwakman, Dilawar Shah Pal, Debajyoti Arpnikanondt, Chonlameth |
author_facet | Zwakman, Dilawar Shah Pal, Debajyoti Arpnikanondt, Chonlameth |
author_sort | Zwakman, Dilawar Shah |
collection | PubMed |
description | Currently, the use of voice-assistants has been on the rise, but a user-centric usability evaluation of these devices is a must for ensuring their success. System Usability Scale (SUS) is one such popular usability instrument in a Graphical User Interface (GUI) scenario. However, there are certain fundamental differences between GUI and voice-based systems, which makes it uncertain regarding the suitability of SUS in a voice scenario. The present work has a twofold objective: to check the suitability of SUS for usability evaluation of voice-assistants and developing a subjective scale in line with SUS that considers the unique aspects of voice-based communication. We call this scale as the Voice Usability Scale (VUS). For fulfilling the objectives, a subjective test is conducted with 62 participants. An Exploratory Factor Analysis suggests that SUS has a number of drawbacks for measuring the voice usability. Moreover, in case of VUS, the most optimal factor structure identifies three main components: usability, affective, and recognizability and visibility. The current findings should provide an initial starting point to form a useful theoretical and practical basis for subjective usability assessment of voice-based systems. |
format | Online Article Text |
id | pubmed-7798382 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer Singapore |
record_format | MEDLINE/PubMed |
spelling | pubmed-77983822021-01-11 Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa Zwakman, Dilawar Shah Pal, Debajyoti Arpnikanondt, Chonlameth SN Comput Sci Original Research Currently, the use of voice-assistants has been on the rise, but a user-centric usability evaluation of these devices is a must for ensuring their success. System Usability Scale (SUS) is one such popular usability instrument in a Graphical User Interface (GUI) scenario. However, there are certain fundamental differences between GUI and voice-based systems, which makes it uncertain regarding the suitability of SUS in a voice scenario. The present work has a twofold objective: to check the suitability of SUS for usability evaluation of voice-assistants and developing a subjective scale in line with SUS that considers the unique aspects of voice-based communication. We call this scale as the Voice Usability Scale (VUS). For fulfilling the objectives, a subjective test is conducted with 62 participants. An Exploratory Factor Analysis suggests that SUS has a number of drawbacks for measuring the voice usability. Moreover, in case of VUS, the most optimal factor structure identifies three main components: usability, affective, and recognizability and visibility. The current findings should provide an initial starting point to form a useful theoretical and practical basis for subjective usability assessment of voice-based systems. Springer Singapore 2021-01-11 2021 /pmc/articles/PMC7798382/ /pubmed/33458698 http://dx.doi.org/10.1007/s42979-020-00424-4 Text en © The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd. part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Original Research Zwakman, Dilawar Shah Pal, Debajyoti Arpnikanondt, Chonlameth Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title | Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title_full | Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title_fullStr | Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title_full_unstemmed | Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title_short | Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon Alexa |
title_sort | usability evaluation of artificial intelligence-based voice assistants: the case of amazon alexa |
topic | Original Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7798382/ https://www.ncbi.nlm.nih.gov/pubmed/33458698 http://dx.doi.org/10.1007/s42979-020-00424-4 |
work_keys_str_mv | AT zwakmandilawarshah usabilityevaluationofartificialintelligencebasedvoiceassistantsthecaseofamazonalexa AT paldebajyoti usabilityevaluationofartificialintelligencebasedvoiceassistantsthecaseofamazonalexa AT arpnikanondtchonlameth usabilityevaluationofartificialintelligencebasedvoiceassistantsthecaseofamazonalexa |