Cargando…

Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework

BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementati...

Descripción completa

Detalles Bibliográficos
Autores principales: Blackman, Kacie CA, Zoellner, Jamie, Berrey, Leanna M, Alexander, Ramine, Fanning, Jason, Hill, Jennie L, Estabrooks, Paul A
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications Inc. 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3806547/
https://www.ncbi.nlm.nih.gov/pubmed/24095951
http://dx.doi.org/10.2196/jmir.2745
_version_ 1782288391984906240
author Blackman, Kacie CA
Zoellner, Jamie
Berrey, Leanna M
Alexander, Ramine
Fanning, Jason
Hill, Jennie L
Estabrooks, Paul A
author_facet Blackman, Kacie CA
Zoellner, Jamie
Berrey, Leanna M
Alexander, Ramine
Fanning, Jason
Hill, Jennie L
Estabrooks, Paul A
author_sort Blackman, Kacie CA
collection PubMed
description BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. METHODS: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. RESULTS: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. CONCLUSIONS: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level.
format Online
Article
Text
id pubmed-3806547
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher JMIR Publications Inc.
record_format MEDLINE/PubMed
spelling pubmed-38065472013-10-24 Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A J Med Internet Res Review BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. METHODS: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. RESULTS: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. CONCLUSIONS: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level. JMIR Publications Inc. 2013-10-04 /pmc/articles/PMC3806547/ /pubmed/24095951 http://dx.doi.org/10.2196/jmir.2745 Text en ©Kacie CA Blackman, Jamie Zoellner, Leanna M Berrey, Ramine Alexander, Jason Fanning, Jennie L Hill, Paul A Estabrooks. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 04.10.2013. http://creativecommons.org/licenses/by/2.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Review
Blackman, Kacie CA
Zoellner, Jamie
Berrey, Leanna M
Alexander, Ramine
Fanning, Jason
Hill, Jennie L
Estabrooks, Paul A
Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title_full Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title_fullStr Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title_full_unstemmed Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title_short Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
title_sort assessing the internal and external validity of mobile health physical activity promotion interventions: a systematic literature review using the re-aim framework
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3806547/
https://www.ncbi.nlm.nih.gov/pubmed/24095951
http://dx.doi.org/10.2196/jmir.2745
work_keys_str_mv AT blackmankacieca assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT zoellnerjamie assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT berreyleannam assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT alexanderramine assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT fanningjason assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT hilljenniel assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework
AT estabrookspaula assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework