Cargando…
A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics
BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6121139/ https://www.ncbi.nlm.nih.gov/pubmed/30126832 http://dx.doi.org/10.2196/mental.8594 |
_version_ | 1783352400445177856 |
---|---|
author | Song, Michael Jae Ward, John Choi, Fiona Nikoo, Mohammadali Frank, Anastasia Shams, Farhud Tabi, Katarina Vigo, Daniel Krausz, Michael |
author_facet | Song, Michael Jae Ward, John Choi, Fiona Nikoo, Mohammadali Frank, Anastasia Shams, Farhud Tabi, Katarina Vigo, Daniel Krausz, Michael |
author_sort | Song, Michael Jae |
collection | PubMed |
description | BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE: The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS: Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS: The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS: Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools. |
format | Online Article Text |
id | pubmed-6121139 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | JMIR Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-61211392018-09-06 A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics Song, Michael Jae Ward, John Choi, Fiona Nikoo, Mohammadali Frank, Anastasia Shams, Farhud Tabi, Katarina Vigo, Daniel Krausz, Michael JMIR Ment Health Original Paper BACKGROUND: Despite the increasing amount of research on Web-based mental health interventions with proven efficacy, high attrition rates decrease their effectiveness. Continued process evaluations should be performed to maximize the target population’s engagement. Google Analytics has been used to evaluate various health-related Web-based programs and may also be useful for Web-based mental health programs. OBJECTIVE: The objective of our study was to evaluate WalkAlong.ca, a youth-oriented mental health web-portal, using Google Analytics to inform the improvement strategy for the platform and to demonstrate the use of Google Analytics as a tool for process evaluation of Web-based mental health interventions. METHODS: Google Analytics was used to monitor user activity during WalkAlong’s first year of operation (Nov 13, 2013-Nov 13, 2014). Selected Google Analytic variables were overall website engagement including pages visited per session, utilization rate of specific features, and user access mode and location. RESULTS: The results included data from 3076 users viewing 29,299 pages. Users spent less average time on Mindsteps (0 minute 35 seconds) and self-exercises (1 minute 08 seconds), which are important self-help tools, compared with that on the Screener tool (3 minutes 4 seconds). Of all visitors, 82.3% (4378/5318) were desktop users, followed by 12.7 % (677/5318) mobile phone and 5.0% (263/5318) tablet users. Both direct traffic (access via URL) and referrals by email had more than 7 pages viewed per session and longer than average time of 6 minutes per session. The majority of users (67%) accessed the platform from Canada. CONCLUSIONS: Engagement and feature utilization rates are higher among people who receive personal invitations to visit the site. Low utilization rates with specific features offer a starting place for further exploration of users in order to identify the root cause. The data provided by Google Analytics, although informative, can be supplemented by other evaluation methods (ie, qualitative methods) in order to better determine the modifications required to improve user engagement. Google Analytics can play a vital role in highlighting the preferences of those using Web-based mental health tools. JMIR Publications 2018-08-20 /pmc/articles/PMC6121139/ /pubmed/30126832 http://dx.doi.org/10.2196/mental.8594 Text en ©Michael Jae Song, John Ward, Fiona Choi, Mohammadali Nikoo, Anastasia Frank, Farhud Shams, Katarina Tabi, Daniel Vigo, Michael Krausz. Originally published in JMIR Mental Health (http://mental.jmir.org), 20.08.2018. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Song, Michael Jae Ward, John Choi, Fiona Nikoo, Mohammadali Frank, Anastasia Shams, Farhud Tabi, Katarina Vigo, Daniel Krausz, Michael A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title | A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title_full | A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title_fullStr | A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title_full_unstemmed | A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title_short | A Process Evaluation of a Web-Based Mental Health Portal (WalkAlong) Using Google Analytics |
title_sort | process evaluation of a web-based mental health portal (walkalong) using google analytics |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6121139/ https://www.ncbi.nlm.nih.gov/pubmed/30126832 http://dx.doi.org/10.2196/mental.8594 |
work_keys_str_mv | AT songmichaeljae aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT wardjohn aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT choifiona aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT nikoomohammadali aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT frankanastasia aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT shamsfarhud aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT tabikatarina aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT vigodaniel aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT krauszmichael aprocessevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT songmichaeljae processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT wardjohn processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT choifiona processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT nikoomohammadali processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT frankanastasia processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT shamsfarhud processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT tabikatarina processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT vigodaniel processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics AT krauszmichael processevaluationofawebbasedmentalhealthportalwalkalongusinggoogleanalytics |