Cargando…
Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments
BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (pr...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
SAGE Publications
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6293457/ https://www.ncbi.nlm.nih.gov/pubmed/30301375 http://dx.doi.org/10.1177/0193841X18799128 |
_version_ | 1783380539722432512 |
---|---|
author | Green, Donald P. Lin, Winston Gerber, Claudia |
author_facet | Green, Donald P. Lin, Winston Gerber, Claudia |
author_sort | Green, Donald P. |
collection | PubMed |
description | BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (preintervention) survey, and an independent random sample is selected for an endline (postintervention) survey. OBJECTIVE: This design raises the question, given a fixed budget, how should a researcher allocate resources between the baseline and endline surveys to maximize the precision of the estimated average treatment effect? RESULTS: We formalize this allocation problem and show that although the optimal share of interviews allocated to the baseline survey is always less than one-half, it is an increasing function of the total number of interviews per cluster, the cluster-level correlation between the baseline measure and the endline outcome, and the intracluster correlation coefficient. An example using multicountry survey data from Africa illustrates how the optimal allocation formulas can be combined with data to inform decisions at the planning stage. Another example uses data from a digital political advertising experiment in Texas to explore how precision would have varied with alternative allocations. |
format | Online Article Text |
id | pubmed-6293457 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | SAGE Publications |
record_format | MEDLINE/PubMed |
spelling | pubmed-62934572018-12-26 Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments Green, Donald P. Lin, Winston Gerber, Claudia Eval Rev Articles BACKGROUND: Many place-based randomized trials and quasi-experiments use a pair of cross-section surveys, rather than panel surveys, to estimate the average treatment effect of an intervention. In these studies, a random sample of individuals in each geographic cluster is selected for a baseline (preintervention) survey, and an independent random sample is selected for an endline (postintervention) survey. OBJECTIVE: This design raises the question, given a fixed budget, how should a researcher allocate resources between the baseline and endline surveys to maximize the precision of the estimated average treatment effect? RESULTS: We formalize this allocation problem and show that although the optimal share of interviews allocated to the baseline survey is always less than one-half, it is an increasing function of the total number of interviews per cluster, the cluster-level correlation between the baseline measure and the endline outcome, and the intracluster correlation coefficient. An example using multicountry survey data from Africa illustrates how the optimal allocation formulas can be combined with data to inform decisions at the planning stage. Another example uses data from a digital political advertising experiment in Texas to explore how precision would have varied with alternative allocations. SAGE Publications 2018-10-09 2018-08 /pmc/articles/PMC6293457/ /pubmed/30301375 http://dx.doi.org/10.1177/0193841X18799128 Text en © The Author(s) 2018 http://creativecommons.org/licenses/by-nc/4.0/ This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (http://www.creativecommons.org/licenses/by-nc/4.0/) which permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage). |
spellingShingle | Articles Green, Donald P. Lin, Winston Gerber, Claudia Optimal Allocation of Interviews to Baseline and Endline Surveys in Place-Based Randomized Trials and Quasi-Experiments |
title | Optimal Allocation of Interviews to Baseline and Endline Surveys in
Place-Based Randomized Trials and Quasi-Experiments |
title_full | Optimal Allocation of Interviews to Baseline and Endline Surveys in
Place-Based Randomized Trials and Quasi-Experiments |
title_fullStr | Optimal Allocation of Interviews to Baseline and Endline Surveys in
Place-Based Randomized Trials and Quasi-Experiments |
title_full_unstemmed | Optimal Allocation of Interviews to Baseline and Endline Surveys in
Place-Based Randomized Trials and Quasi-Experiments |
title_short | Optimal Allocation of Interviews to Baseline and Endline Surveys in
Place-Based Randomized Trials and Quasi-Experiments |
title_sort | optimal allocation of interviews to baseline and endline surveys in
place-based randomized trials and quasi-experiments |
topic | Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6293457/ https://www.ncbi.nlm.nih.gov/pubmed/30301375 http://dx.doi.org/10.1177/0193841X18799128 |
work_keys_str_mv | AT greendonaldp optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments AT linwinston optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments AT gerberclaudia optimalallocationofinterviewstobaselineandendlinesurveysinplacebasedrandomizedtrialsandquasiexperiments |