Cargando…

A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics

BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to...

Descripción completa

Detalles Bibliográficos
Autores principales: Song, Michael Jae, Ward, John, Choi, Fiona, Nikoo, Mohammadali, Frank, Anastasia, Shams, Farhud, Tabi, Katarina, Vigo, Daniel, Krausz, Michael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6121139/
https://www.ncbi.nlm.nih.gov/pubmed/30126832
http://dx.doi.org/10.2196/mental.8594
_version_ 1783352400445177856
author Song, Michael Jae
Ward, John
Choi, Fiona
Nikoo, Mohammadali
Frank, Anastasia
Shams, Farhud
Tabi, Katarina
Vigo, Daniel
Krausz, Michael
author_facet Song, Michael Jae
Ward, John
Choi, Fiona
Nikoo, Mohammadali
Frank, Anastasia
Shams, Farhud
Tabi, Katarina
Vigo, Daniel
Krausz, Michael
author_sort Song, Michael Jae
collection PubMed
description BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE: The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS: Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS: The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS: Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools.
format Online
Article
Text
id pubmed-6121139
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-61211392018-09-06 A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics Song, Michael Jae Ward, John Choi, Fiona Nikoo, Mohammadali Frank, Anastasia Shams, Farhud Tabi, Katarina Vigo, Daniel Krausz, Michael JMIR Ment Health Original Paper BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE: The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS: Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS: The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS: Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools. JMIR Publications 2018-08-20 /pmc/articles/PMC6121139/ /pubmed/30126832 http://dx.doi.org/10.2196/mental.8594 Text en ©Michael Jae Song, John Ward, Fiona Choi, Mohammadali Nikoo, Anastasia Frank, Farhud Shams, Katarina Tabi, Daniel Vigo, Michael Krausz. Originally published in JMIR Mental Health (http://mental.jmir.org), 20.08.2018. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Song, Michael Jae
Ward, John
Choi, Fiona
Nikoo, Mohammadali
Frank, Anastasia
Shams, Farhud
Tabi, Katarina
Vigo, Daniel
Krausz, Michael
A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title_full A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title_fullStr A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title_full_unstemmed A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title_short A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
title_sort process evaluation of a web-based mental health portal (walkalong) using google analytics
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6121139/
https://www.ncbi.nlm.nih.gov/pubmed/30126832
http://dx.doi.org/10.2196/mental.8594
work_keys_str_mv AT songmichaeljae aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT wardjohn aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT choifiona aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT nikoomohammadali aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT frankanastasia aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT shamsfarhud aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT tabikatarina aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT vigodaniel aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT krauszmichael aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT songmichaeljae processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT wardjohn processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT choifiona processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT nikoomohammadali processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT frankanastasia processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT shamsfarhud processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT tabikatarina processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT vigodaniel processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics
AT krauszmichael processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics