Cargando…

Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review

BACKGROUND: Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding...

Descripción completa

Detalles Bibliográficos
Autores principales: Johnson, Susanne Grødem, Potrebny, Thomas, Larun, Lillebeth, Ciliska, Donna, Olsen, Nina Rydland
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9280458/
https://www.ncbi.nlm.nih.gov/pubmed/35767323
http://dx.doi.org/10.2196/38259
_version_ 1784746649549012992
author Johnson, Susanne Grødem
Potrebny, Thomas
Larun, Lillebeth
Ciliska, Donna
Olsen, Nina Rydland
author_facet Johnson, Susanne Grødem
Potrebny, Thomas
Larun, Lillebeth
Ciliska, Donna
Olsen, Nina Rydland
author_sort Johnson, Susanne Grødem
collection PubMed
description BACKGROUND: Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users’ needs. No previous reviews have investigated the usability of mobile apps developed for health care education. OBJECTIVE: The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education. METHODS: A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O’Malley framework for scoping reviews. RESULTS: Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method. CONCLUSIONS: Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/19072
format Online
Article
Text
id pubmed-9280458
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-92804582022-07-15 Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review Johnson, Susanne Grødem Potrebny, Thomas Larun, Lillebeth Ciliska, Donna Olsen, Nina Rydland JMIR Med Educ Review BACKGROUND: Mobile devices can provide extendable learning environments in higher education and motivate students to engage in adaptive and collaborative learning. Developers must design mobile apps that are practical, effective, and easy to use, and usability testing is essential for understanding how mobile apps meet users’ needs. No previous reviews have investigated the usability of mobile apps developed for health care education. OBJECTIVE: The aim of this scoping review is to identify usability methods and attributes in usability studies of mobile apps for health care education. METHODS: A comprehensive search was carried out in 10 databases, reference lists, and gray literature. Studies were included if they dealt with health care students and usability of mobile apps for learning. Frequencies and percentages were used to present the nominal data, together with tables and graphical illustrations. Examples include a figure of the study selection process, an illustration of the frequency of inquiry usability evaluation and data collection methods, and an overview of the distribution of the identified usability attributes. We followed the Arksey and O’Malley framework for scoping reviews. RESULTS: Our scoping review collated 88 articles involving 98 studies, mainly related to medical and nursing students. The studies were conducted from 22 countries and were published between 2008 and 2021. Field testing was the main usability experiment used, and the usability evaluation methods were either inquiry-based or based on user testing. Inquiry methods were predominantly used: 1-group design (46/98, 47%), control group design (12/98, 12%), randomized controlled trials (12/98, 12%), mixed methods (12/98, 12%), and qualitative methods (11/98, 11%). User testing methods applied were all think aloud (5/98, 5%). A total of 17 usability attributes were identified; of these, satisfaction, usefulness, ease of use, learning performance, and learnability were reported most frequently. The most frequently used data collection method was questionnaires (83/98, 85%), but only 19% (19/98) of studies used a psychometrically tested usability questionnaire. Other data collection methods included focus group interviews, knowledge and task performance testing, and user data collected from apps, interviews, written qualitative reflections, and observations. Most of the included studies used more than one data collection method. CONCLUSIONS: Experimental designs were the most commonly used methods for evaluating usability, and most studies used field testing. Questionnaires were frequently used for data collection, although few studies used psychometrically tested questionnaires. The usability attributes identified most often were satisfaction, usefulness, and ease of use. The results indicate that combining different usability evaluation methods, incorporating both subjective and objective usability measures, and specifying which usability attributes to test seem advantageous. The results can support the planning and conduct of future usability studies for the advancement of mobile learning apps in health care education. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/19072 JMIR Publications 2022-06-29 /pmc/articles/PMC9280458/ /pubmed/35767323 http://dx.doi.org/10.2196/38259 Text en ©Susanne Grødem Johnson, Thomas Potrebny, Lillebeth Larun, Donna Ciliska, Nina Rydland Olsen. Originally published in JMIR Medical Education (https://mededu.jmir.org), 29.06.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Education, is properly cited. The complete bibliographic information, a link to the original publication on https://mededu.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Review
Johnson, Susanne Grødem
Potrebny, Thomas
Larun, Lillebeth
Ciliska, Donna
Olsen, Nina Rydland
Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title_full Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title_fullStr Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title_full_unstemmed Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title_short Usability Methods and Attributes Reported in Usability Studies of Mobile Apps for Health Care Education: Scoping Review
title_sort usability methods and attributes reported in usability studies of mobile apps for health care education: scoping review
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9280458/
https://www.ncbi.nlm.nih.gov/pubmed/35767323
http://dx.doi.org/10.2196/38259
work_keys_str_mv AT johnsonsusannegrødem usabilitymethodsandattributesreportedinusabilitystudiesofmobileappsforhealthcareeducationscopingreview
AT potrebnythomas usabilitymethodsandattributesreportedinusabilitystudiesofmobileappsforhealthcareeducationscopingreview
AT larunlillebeth usabilitymethodsandattributesreportedinusabilitystudiesofmobileappsforhealthcareeducationscopingreview
AT ciliskadonna usabilitymethodsandattributesreportedinusabilitystudiesofmobileappsforhealthcareeducationscopingreview
AT olsenninarydland usabilitymethodsandattributesreportedinusabilitystudiesofmobileappsforhealthcareeducationscopingreview