Cargando…

Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial

BACKGROUND: Drink Less is a behavior change app that aims to help users in the general adult population reduce hazardous and harmful alcohol consumption. The app includes a daily push notification, delivered at 11 am, asking users to “Please complete your mood and drinking diaries.” Previous analysi...

Descripción completa

Detalles Bibliográficos
Autores principales: Bell, Lauren, Garnett, Claire, Qian, Tianchen, Perski, Olga, Potts, Henry W W, Williamson, Elizabeth
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7442945/
https://www.ncbi.nlm.nih.gov/pubmed/32763878
http://dx.doi.org/10.2196/18690
_version_ 1783573537603190784
author Bell, Lauren
Garnett, Claire
Qian, Tianchen
Perski, Olga
Potts, Henry W W
Williamson, Elizabeth
author_facet Bell, Lauren
Garnett, Claire
Qian, Tianchen
Perski, Olga
Potts, Henry W W
Williamson, Elizabeth
author_sort Bell, Lauren
collection PubMed
description BACKGROUND: Drink Less is a behavior change app that aims to help users in the general adult population reduce hazardous and harmful alcohol consumption. The app includes a daily push notification, delivered at 11 am, asking users to “Please complete your mood and drinking diaries.” Previous analysis of Drink Less engagement data suggests the current notification strongly influences how users engage with the app in the subsequent hour. To exploit a potential increase of vulnerability of excess drinking and opportunity to engage with the app in the evenings, we changed the delivery time from 11 am to 8 pm. We now aim to further optimise the content and sequence of notifications, testing 30 new evidence-informed notifications targeting the user’s perceived usefulness of the app. OBJECTIVE: The primary objective is to assess whether sending a notification at 8 pm increases behavioral engagement (opening the app) in the subsequent hour. Secondary objectives include comparing the effect of the new bank of messages with the standard message and effect moderation over time. We also aim to more generally understand the role notifications have on the overall duration, depth, and frequency of engagement with Drink Less over the first 30 days after download. METHODS: This is a protocol for a micro-randomized trial with two additional parallel arms. Inclusion criteria are Drink Less users who (1) consent to participate in the trial; (2) self-report a baseline Alcohol Use Disorders Identification Test score of 8 or above; (3) reside in the United Kingdom; (4) age ≥18 years and; (5) report interest in drinking less alcohol. In the micro-randomized trial, participants will be randomized daily at 8 pm to receive no notification, a notification with text from the new message bank, or the standard message. The primary outcome is the time-varying, binary outcome of “Did the user open the app in the hour from 8 pm to 9 pm?”. The primary analysis will estimate the marginal relative risk for the notifications using an estimator developed for micro-randomized trials with binary outcomes. Participants randomized to the parallel arms will receive no notifications (Secondary Arm A), or the standard notification delivered daily at 11 am (Secondary Arm B) over 30 days, allowing the comparison of overall engagement between different notification delivery strategies. RESULTS: Approval was granted by the University College of London’s Departmental Research Ethics Committee (CEHP/2016/556) on October 11, 2019, and The London School of Hygiene and Tropical Medicine Interventions Research Ethics Committee (17929) on November 27, 2019. Recruitment began on January 2, 2020, and is ongoing. CONCLUSIONS: Understanding how push notifications may impact engagement with a behavior change app can lead to further improvements in engagement, and ultimately help users reduce their alcohol consumption. This understanding may also be generalizable to other apps that target a variety of behavior changes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/18690
format Online
Article
Text
id pubmed-7442945
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-74429452020-09-04 Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial Bell, Lauren Garnett, Claire Qian, Tianchen Perski, Olga Potts, Henry W W Williamson, Elizabeth JMIR Res Protoc Protocol BACKGROUND: Drink Less is a behavior change app that aims to help users in the general adult population reduce hazardous and harmful alcohol consumption. The app includes a daily push notification, delivered at 11 am, asking users to “Please complete your mood and drinking diaries.” Previous analysis of Drink Less engagement data suggests the current notification strongly influences how users engage with the app in the subsequent hour. To exploit a potential increase of vulnerability of excess drinking and opportunity to engage with the app in the evenings, we changed the delivery time from 11 am to 8 pm. We now aim to further optimise the content and sequence of notifications, testing 30 new evidence-informed notifications targeting the user’s perceived usefulness of the app. OBJECTIVE: The primary objective is to assess whether sending a notification at 8 pm increases behavioral engagement (opening the app) in the subsequent hour. Secondary objectives include comparing the effect of the new bank of messages with the standard message and effect moderation over time. We also aim to more generally understand the role notifications have on the overall duration, depth, and frequency of engagement with Drink Less over the first 30 days after download. METHODS: This is a protocol for a micro-randomized trial with two additional parallel arms. Inclusion criteria are Drink Less users who (1) consent to participate in the trial; (2) self-report a baseline Alcohol Use Disorders Identification Test score of 8 or above; (3) reside in the United Kingdom; (4) age ≥18 years and; (5) report interest in drinking less alcohol. In the micro-randomized trial, participants will be randomized daily at 8 pm to receive no notification, a notification with text from the new message bank, or the standard message. The primary outcome is the time-varying, binary outcome of “Did the user open the app in the hour from 8 pm to 9 pm?”. The primary analysis will estimate the marginal relative risk for the notifications using an estimator developed for micro-randomized trials with binary outcomes. Participants randomized to the parallel arms will receive no notifications (Secondary Arm A), or the standard notification delivered daily at 11 am (Secondary Arm B) over 30 days, allowing the comparison of overall engagement between different notification delivery strategies. RESULTS: Approval was granted by the University College of London’s Departmental Research Ethics Committee (CEHP/2016/556) on October 11, 2019, and The London School of Hygiene and Tropical Medicine Interventions Research Ethics Committee (17929) on November 27, 2019. Recruitment began on January 2, 2020, and is ongoing. CONCLUSIONS: Understanding how push notifications may impact engagement with a behavior change app can lead to further improvements in engagement, and ultimately help users reduce their alcohol consumption. This understanding may also be generalizable to other apps that target a variety of behavior changes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/18690 JMIR Publications 2020-08-07 /pmc/articles/PMC7442945/ /pubmed/32763878 http://dx.doi.org/10.2196/18690 Text en ©Lauren Bell, Claire Garnett, Tianchen Qian, Olga Perski, Henry W W Potts, Elizabeth Williamson. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 07.08.2020. https://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.
spellingShingle Protocol
Bell, Lauren
Garnett, Claire
Qian, Tianchen
Perski, Olga
Potts, Henry W W
Williamson, Elizabeth
Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title_full Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title_fullStr Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title_full_unstemmed Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title_short Notifications to Improve Engagement With an Alcohol Reduction App: Protocol for a Micro-Randomized Trial
title_sort notifications to improve engagement with an alcohol reduction app: protocol for a micro-randomized trial
topic Protocol
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7442945/
https://www.ncbi.nlm.nih.gov/pubmed/32763878
http://dx.doi.org/10.2196/18690
work_keys_str_mv AT belllauren notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial
AT garnettclaire notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial
AT qiantianchen notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial
AT perskiolga notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial
AT pottshenryww notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial
AT williamsonelizabeth notificationstoimproveengagementwithanalcoholreductionappprotocolforamicrorandomizedtrial