Cargando…
Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementati...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
JMIR Publications Inc.
2013
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3806547/ https://www.ncbi.nlm.nih.gov/pubmed/24095951 http://dx.doi.org/10.2196/jmir.2745 |
_version_ | 1782288391984906240 |
---|---|
author | Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A |
author_facet | Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A |
author_sort | Blackman, Kacie CA |
collection | PubMed |
description | BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. METHODS: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. RESULTS: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. CONCLUSIONS: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level. |
format | Online Article Text |
id | pubmed-3806547 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2013 |
publisher | JMIR Publications Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-38065472013-10-24 Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A J Med Internet Res Review BACKGROUND: Mobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. OBJECTIVE: The purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. METHODS: Twenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. RESULTS: The majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. CONCLUSIONS: This review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level. JMIR Publications Inc. 2013-10-04 /pmc/articles/PMC3806547/ /pubmed/24095951 http://dx.doi.org/10.2196/jmir.2745 Text en ©Kacie CA Blackman, Jamie Zoellner, Leanna M Berrey, Ramine Alexander, Jason Fanning, Jennie L Hill, Paul A Estabrooks. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 04.10.2013. http://creativecommons.org/licenses/by/2.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Review Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title_full | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title_fullStr | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title_full_unstemmed | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title_short | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
title_sort | assessing the internal and external validity of mobile health physical activity promotion interventions: a systematic literature review using the re-aim framework |
topic | Review |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3806547/ https://www.ncbi.nlm.nih.gov/pubmed/24095951 http://dx.doi.org/10.2196/jmir.2745 |
work_keys_str_mv | AT blackmankacieca assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT zoellnerjamie assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT berreyleannam assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT alexanderramine assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT fanningjason assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT hilljenniel assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT estabrookspaula assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework |