Cargando…

Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments

BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Green, Donald P., Lin, Winston, Gerber, Claudia
Formato: Online Artículo Texto
Lenguaje:English
Publicado: SAGE Publications 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6293457/
https://www.ncbi.nlm.nih.gov/pubmed/30301375
http://dx.doi.org/10.1177/0193841X18799128
_version_ 1783380539722432512
author Green, Donald P.
Lin, Winston
Gerber, Claudia
author_facet Green, Donald P.
Lin, Winston
Gerber, Claudia
author_sort Green, Donald P.
collection PubMed
description BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (preintervention) survey, and an independent random sample is selected for an endline (postintervention) survey. OBJECTIVE: This design raises the question, given a fixed budget, how should a researcher allocate resources between the baseline and endline surveys to maximize the precision of the estimated average treatment effect? RESULTS: We formalize this allocation problem and show that although the optimal share of interviews allocated to the baseline survey is always less than one-half, it is an increasing function of the total number of interviews per cluster, the cluster-level correlation between the baseline measure and the endline outcome, and the intracluster correlation coefficient. An example using multicountry survey data from Africa illustrates how the optimal allocation formulas can be combined with data to inform decisions at the planning stage. Another example uses data from a digital political advertising experiment in Texas to explore how precision would have varied with alternative allocations.
format Online
Article
Text
id pubmed-6293457
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher SAGE Publications
record_format MEDLINE/PubMed
spelling pubmed-62934572018-12-26 Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments Green, Donald P. Lin, Winston Gerber, Claudia Eval Rev Articles BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (preintervention) survey, and an independent random sample is selected for an endline (postintervention) survey. OBJECTIVE: This design raises the question, given a fixed budget, how should a researcher allocate resources between the baseline and endline surveys to maximize the precision of the estimated average treatment effect? RESULTS: We formalize this allocation problem and show that although the optimal share of interviews allocated to the baseline survey is always less than one-half, it is an increasing function of the total number of interviews per cluster, the cluster-level correlation between the baseline measure and the endline outcome, and the intracluster correlation coefficient. An example using multicountry survey data from Africa illustrates how the optimal allocation formulas can be combined with data to inform decisions at the planning stage. Another example uses data from a digital political advertising experiment in Texas to explore how precision would have varied with alternative allocations. SAGE Publications 2018-10-09 2018-08 /pmc/articles/PMC6293457/ /pubmed/30301375 http://dx.doi.org/10.1177/0193841X18799128 Text en © The Author(s) 2018 http://creativecommons.org/licenses/by-nc/4.0/ This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (http://www.creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
spellingShingle Articles
Green, Donald P.
Lin, Winston
Gerber, Claudia
Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title_full Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title_fullStr Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title_full_unstemmed Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title_short Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
title_sort optimal allocation of interviews to baseline and endline surveys in place-based randomized trials and quasi-experiments
topic Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6293457/
https://www.ncbi.nlm.nih.gov/pubmed/30301375
http://dx.doi.org/10.1177/0193841X18799128
work_keys_str_mv AT greendonaldp optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments
AT linwinston optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments
AT gerberclaudia optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments