Cargando…

RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings

Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and...

Descripción completa

Detalles Bibliográficos
Autores principales: Kwan, Bethany M., McGinnes, Hannah L., Ory, Marcia G., Estabrooks, Paul A., Waxmonsky, Jeanette A., Glasgow, Russell E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6883916/
https://www.ncbi.nlm.nih.gov/pubmed/31824911
http://dx.doi.org/10.3389/fpubh.2019.00345
_version_ 1783474470941360128
author Kwan, Bethany M.
McGinnes, Hannah L.
Ory, Marcia G.
Estabrooks, Paul A.
Waxmonsky, Jeanette A.
Glasgow, Russell E.
author_facet Kwan, Bethany M.
McGinnes, Hannah L.
Ory, Marcia G.
Estabrooks, Paul A.
Waxmonsky, Jeanette A.
Glasgow, Russell E.
author_sort Kwan, Bethany M.
collection PubMed
description Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and identify opportunities for improving use outside of research contexts. Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data. Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0–3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert. Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.
format Online
Article
Text
id pubmed-6883916
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-68839162019-12-10 RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings Kwan, Bethany M. McGinnes, Hannah L. Ory, Marcia G. Estabrooks, Paul A. Waxmonsky, Jeanette A. Glasgow, Russell E. Front Public Health Public Health Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and identify opportunities for improving use outside of research contexts. Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data. Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0–3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert. Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement. Frontiers Media S.A. 2019-11-22 /pmc/articles/PMC6883916/ /pubmed/31824911 http://dx.doi.org/10.3389/fpubh.2019.00345 Text en Copyright © 2019 Kwan, McGinnes, Ory, Estabrooks, Waxmonsky and Glasgow. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Public Health
Kwan, Bethany M.
McGinnes, Hannah L.
Ory, Marcia G.
Estabrooks, Paul A.
Waxmonsky, Jeanette A.
Glasgow, Russell E.
RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title_full RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title_fullStr RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title_full_unstemmed RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title_short RE-AIM in the Real World: Use of the RE-AIM Framework for Program Planning and Evaluation in Clinical and Community Settings
title_sort re-aim in the real world: use of the re-aim framework for program planning and evaluation in clinical and community settings
topic Public Health
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6883916/
https://www.ncbi.nlm.nih.gov/pubmed/31824911
http://dx.doi.org/10.3389/fpubh.2019.00345
work_keys_str_mv AT kwanbethanym reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings
AT mcginneshannahl reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings
AT orymarciag reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings
AT estabrookspaula reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings
AT waxmonskyjeanettea reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings
AT glasgowrusselle reaimintherealworlduseofthereaimframeworkforprogramplanningandevaluationinclinicalandcommunitysettings