Cargando…

Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process

Background  With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, develo...

Descripción completa

Detalles Bibliográficos
Autores principales: Richter Lagha, Regina, Burningham, Zachary, Sauer, Brian C., Leng, Jianwei, Peters, Celena, Huynh, Tina, Patel, Shardool, Halwani, Ahmad S., Kramer, B. Josea
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Georg Thieme Verlag KG 2020
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7425799/
https://www.ncbi.nlm.nih.gov/pubmed/32785904
http://dx.doi.org/10.1055/s-0040-1714693
_version_ 1783570565491064832
author Richter Lagha, Regina
Burningham, Zachary
Sauer, Brian C.
Leng, Jianwei
Peters, Celena
Huynh, Tina
Patel, Shardool
Halwani, Ahmad S.
Kramer, B. Josea
author_facet Richter Lagha, Regina
Burningham, Zachary
Sauer, Brian C.
Leng, Jianwei
Peters, Celena
Huynh, Tina
Patel, Shardool
Halwani, Ahmad S.
Kramer, B. Josea
author_sort Richter Lagha, Regina
collection PubMed
description Background  With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation. Objectives  Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques. Methods  We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni. Results  Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose. Conclusion  Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.
format Online
Article
Text
id pubmed-7425799
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Georg Thieme Verlag KG
record_format MEDLINE/PubMed
spelling pubmed-74257992020-09-09 Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process Richter Lagha, Regina Burningham, Zachary Sauer, Brian C. Leng, Jianwei Peters, Celena Huynh, Tina Patel, Shardool Halwani, Ahmad S. Kramer, B. Josea Appl Clin Inform Background  With the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation. Objectives  Prior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques. Methods  We developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni. Results  Our structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose. Conclusion  Reliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement. Georg Thieme Verlag KG 2020-08 2020-08-12 /pmc/articles/PMC7425799/ /pubmed/32785904 http://dx.doi.org/10.1055/s-0040-1714693 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License, which permits unrestricted reproduction and distribution, for non-commercial purposes only; and use and reproduction, but not distribution, of adapted material for non-commercial purposes only, provided the original work is properly cited.
spellingShingle Richter Lagha, Regina
Burningham, Zachary
Sauer, Brian C.
Leng, Jianwei
Peters, Celena
Huynh, Tina
Patel, Shardool
Halwani, Ahmad S.
Kramer, B. Josea
Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title_full Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title_fullStr Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title_full_unstemmed Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title_short Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process
title_sort usability testing a potentially inappropriate medication dashboard: a core component of the dashboard development process
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7425799/
https://www.ncbi.nlm.nih.gov/pubmed/32785904
http://dx.doi.org/10.1055/s-0040-1714693
work_keys_str_mv AT richterlagharegina usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT burninghamzachary usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT sauerbrianc usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT lengjianwei usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT peterscelena usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT huynhtina usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT patelshardool usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT halwaniahmads usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess
AT kramerbjosea usabilitytestingapotentiallyinappropriatemedicationdashboardacorecomponentofthedashboarddevelopmentprocess