Cargando…

Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund

INTRODUCTION: As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mix...

Descripción completa

Detalles Bibliográficos
Autores principales: Carnahan, Emily, Gurley, Nikki, Asiimwe, Gilbert, Chilundo, Baltazar, Duber, Herbert C., Faye, Adama, Kamya, Carol, Mpanya, Godefroid, Nagasha, Shakilah, Phillips, David, Salisbury, Nicole, Shearer, Jessica, Shelley, Katharine
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Global Health: Science and Practice 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7784079/
https://www.ncbi.nlm.nih.gov/pubmed/33361241
http://dx.doi.org/10.9745/GHSP-D-20-00126
_version_ 1783632232022278144
author Carnahan, Emily
Gurley, Nikki
Asiimwe, Gilbert
Chilundo, Baltazar
Duber, Herbert C.
Faye, Adama
Kamya, Carol
Mpanya, Godefroid
Nagasha, Shakilah
Phillips, David
Salisbury, Nicole
Shearer, Jessica
Shelley, Katharine
author_facet Carnahan, Emily
Gurley, Nikki
Asiimwe, Gilbert
Chilundo, Baltazar
Duber, Herbert C.
Faye, Adama
Kamya, Carol
Mpanya, Godefroid
Nagasha, Shakilah
Phillips, David
Salisbury, Nicole
Shearer, Jessica
Shelley, Katharine
author_sort Carnahan, Emily
collection PubMed
description INTRODUCTION: As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations. METHODS: This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team’s experience from over 7 years (2013–2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned. RESULTS: We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence. CONCLUSION: Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations.
format Online
Article
Text
id pubmed-7784079
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Global Health: Science and Practice
record_format MEDLINE/PubMed
spelling pubmed-77840792021-02-24 Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund Carnahan, Emily Gurley, Nikki Asiimwe, Gilbert Chilundo, Baltazar Duber, Herbert C. Faye, Adama Kamya, Carol Mpanya, Godefroid Nagasha, Shakilah Phillips, David Salisbury, Nicole Shearer, Jessica Shelley, Katharine Glob Health Sci Pract Original Article INTRODUCTION: As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations. METHODS: This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team’s experience from over 7 years (2013–2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned. RESULTS: We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence. CONCLUSION: Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations. Global Health: Science and Practice 2020-12-23 /pmc/articles/PMC7784079/ /pubmed/33361241 http://dx.doi.org/10.9745/GHSP-D-20-00126 Text en © Carnahan et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit http://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-20-00126
spellingShingle Original Article
Carnahan, Emily
Gurley, Nikki
Asiimwe, Gilbert
Chilundo, Baltazar
Duber, Herbert C.
Faye, Adama
Kamya, Carol
Mpanya, Godefroid
Nagasha, Shakilah
Phillips, David
Salisbury, Nicole
Shearer, Jessica
Shelley, Katharine
Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title_full Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title_fullStr Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title_full_unstemmed Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title_short Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund
title_sort lessons learned from implementing prospective, multicountry mixed-methods evaluations for gavi and the global fund
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7784079/
https://www.ncbi.nlm.nih.gov/pubmed/33361241
http://dx.doi.org/10.9745/GHSP-D-20-00126
work_keys_str_mv AT carnahanemily lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT gurleynikki lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT asiimwegilbert lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT chilundobaltazar lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT duberherbertc lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT fayeadama lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT kamyacarol lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT mpanyagodefroid lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT nagashashakilah lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT phillipsdavid lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT salisburynicole lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT shearerjessica lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund
AT shelleykatharine lessonslearnedfromimplementingprospectivemulticountrymixedmethodsevaluationsforgaviandtheglobalfund