Cargando…

Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned

INTRODUCTION: The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, A...

Descripción completa

Detalles Bibliográficos
Autores principales: Kenney, Rachael R., Klocko, Robert P., Manheim, Chelsea E., Mog, Ashley C., Young, Jessica P.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10421720/
https://www.ncbi.nlm.nih.gov/pubmed/37575975
http://dx.doi.org/10.3389/frhs.2023.1209600
_version_ 1785089034815537152
author Kenney, Rachael R.
Klocko, Robert P.
Manheim, Chelsea E.
Mog, Ashley C.
Young, Jessica P.
author_facet Kenney, Rachael R.
Klocko, Robert P.
Manheim, Chelsea E.
Mog, Ashley C.
Young, Jessica P.
author_sort Kenney, Rachael R.
collection PubMed
description INTRODUCTION: The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation. MATERIALS AND METHODS: The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback. RESULTS: Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, “buckets” are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described. DISCUSSION: Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used.
format Online
Article
Text
id pubmed-10421720
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-104217202023-08-12 Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned Kenney, Rachael R. Klocko, Robert P. Manheim, Chelsea E. Mog, Ashley C. Young, Jessica P. Front Health Serv Health Services INTRODUCTION: The United States Veterans Health Administration (VHA) Office of Rural Health funds Enterprise-Wide Initiatives (system-wide initiatives) to spread promising practices to rural Veterans. The Office requires that evaluations of Enterprise-Wide Initiatives use the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. This presents a unique opportunity to understand the experience of using RE-AIM across a series of evaluations. The authors conducted a study to document the benefits and pitfalls of using RE-AIM, capture the variety of ways that the team captured the elements of RE-AIM, and develop recommendations for the future use of RE-AIM in evaluation. MATERIALS AND METHODS: The authors first conducted a document review to capture pre-existing information about how RE-AIM was used. They subsequently facilitated two focus groups to gather more detailed information from team members who had used RE-AIM. Finally, they used member-checking throughout the writing process to ensure accurate data representation and interpretation and to gather additional feedback. RESULTS: Four themes emerged from the document review, focus groups, and member checking. RE-AIM: provides parameters and controls the evaluation scope, “buckets” are logical, plays well with other frameworks, and can foster collaboration or silo within a team. Challenges and attributes for each RE-AIM dimension were also described. DISCUSSION: Overall, participants reported both strengths and challenges to using RE-AIM as an evaluation framework. The overarching theme around the challenges with RE-AIM dimensions was the importance of context. Many of these benefits and challenges of using RE-AIM may not be unique to RE-AIM and would likely occur when using any prescribed framework. The participants reported on the RE-AIM domains in a variety of ways in their evaluation reports and were not always able capture data as originally planned. Recommendations included: start with an evaluation framework (or frameworks) and revisit it throughout the evaluation, consider applying RE-AIM PRISM (Practical Robust Implementation Framework) to gain a broader perspective, and intentionally integrate quantitative and qualitative team members, regardless of the framework used. Frontiers Media S.A. 2023-07-28 /pmc/articles/PMC10421720/ /pubmed/37575975 http://dx.doi.org/10.3389/frhs.2023.1209600 Text en © 2023 Kenney, Klocko, Manheim, Mog and Young. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) (https://creativecommons.org/licenses/by/4.0/) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Health Services
Kenney, Rachael R.
Klocko, Robert P.
Manheim, Chelsea E.
Mog, Ashley C.
Young, Jessica P.
Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title_full Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title_fullStr Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title_full_unstemmed Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title_short Applying RE-AIM to evaluations of Veterans Health Administration Enterprise-Wide Initiatives: lessons learned
title_sort applying re-aim to evaluations of veterans health administration enterprise-wide initiatives: lessons learned
topic Health Services
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10421720/
https://www.ncbi.nlm.nih.gov/pubmed/37575975
http://dx.doi.org/10.3389/frhs.2023.1209600
work_keys_str_mv AT kenneyrachaelr applyingreaimtoevaluationsofveteranshealthadministrationenterprisewideinitiativeslessonslearned
AT klockorobertp applyingreaimtoevaluationsofveteranshealthadministrationenterprisewideinitiativeslessonslearned
AT manheimchelseae applyingreaimtoevaluationsofveteranshealthadministrationenterprisewideinitiativeslessonslearned
AT mogashleyc applyingreaimtoevaluationsofveteranshealthadministrationenterprisewideinitiativeslessonslearned
AT youngjessicap applyingreaimtoevaluationsofveteranshealthadministrationenterprisewideinitiativeslessonslearned