Cargando…

Estimating the total treatment effect in randomized experiments with unknown network structure

Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider s...

Descripción completa

Detalles Bibliográficos
Autores principales: Yu, Christina Lee, Airoldi, Edoardo M., Borgs, Christian, Chayes, Jennifer T.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9636977/
https://www.ncbi.nlm.nih.gov/pubmed/36279463
http://dx.doi.org/10.1073/pnas.2208975119
_version_ 1784825075976896512
author Yu, Christina Lee
Airoldi, Edoardo M.
Borgs, Christian
Chayes, Jennifer T.
author_facet Yu, Christina Lee
Airoldi, Edoardo M.
Borgs, Christian
Chayes, Jennifer T.
author_sort Yu, Christina Lee
collection PubMed
description Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider situations where classical methods for estimating the total treatment effect on a target population are considerably biased due to confounding network effects, i.e., the fact that the treatment of an individual may impact its neighbors’ outcomes, an issue referred to as network interference or as nonindividualized treatment response. A key challenge in these situations is that the network is often unknown and difficult or costly to measure. We assume a potential outcomes model with heterogeneous additive network effects, encompassing a broad class of network interference sources, including spillover, peer effects, and contagion. First, we characterize the limitations in estimating the total treatment effect without knowledge of the network that drives interference. By contrast, we subsequently develop a simple estimator and efficient randomized design that outputs an unbiased estimate with low variance in situations where one is given access to average historical baseline measurements prior to the experiment. Our solution does not require knowledge of the underlying network structure, and it comes with statistical guarantees for a broad class of models. Due to their ease of interpretation and implementation, and their theoretical guarantees, we believe our results will have significant impact on the design of randomized experiments.
format Online
Article
Text
id pubmed-9636977
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-96369772022-11-06 Estimating the total treatment effect in randomized experiments with unknown network structure Yu, Christina Lee Airoldi, Edoardo M. Borgs, Christian Chayes, Jennifer T. Proc Natl Acad Sci U S A Physical Sciences Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider situations where classical methods for estimating the total treatment effect on a target population are considerably biased due to confounding network effects, i.e., the fact that the treatment of an individual may impact its neighbors’ outcomes, an issue referred to as network interference or as nonindividualized treatment response. A key challenge in these situations is that the network is often unknown and difficult or costly to measure. We assume a potential outcomes model with heterogeneous additive network effects, encompassing a broad class of network interference sources, including spillover, peer effects, and contagion. First, we characterize the limitations in estimating the total treatment effect without knowledge of the network that drives interference. By contrast, we subsequently develop a simple estimator and efficient randomized design that outputs an unbiased estimate with low variance in situations where one is given access to average historical baseline measurements prior to the experiment. Our solution does not require knowledge of the underlying network structure, and it comes with statistical guarantees for a broad class of models. Due to their ease of interpretation and implementation, and their theoretical guarantees, we believe our results will have significant impact on the design of randomized experiments. National Academy of Sciences 2022-10-24 2022-11-01 /pmc/articles/PMC9636977/ /pubmed/36279463 http://dx.doi.org/10.1073/pnas.2208975119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Physical Sciences
Yu, Christina Lee
Airoldi, Edoardo M.
Borgs, Christian
Chayes, Jennifer T.
Estimating the total treatment effect in randomized experiments with unknown network structure
title Estimating the total treatment effect in randomized experiments with unknown network structure
title_full Estimating the total treatment effect in randomized experiments with unknown network structure
title_fullStr Estimating the total treatment effect in randomized experiments with unknown network structure
title_full_unstemmed Estimating the total treatment effect in randomized experiments with unknown network structure
title_short Estimating the total treatment effect in randomized experiments with unknown network structure
title_sort estimating the total treatment effect in randomized experiments with unknown network structure
topic Physical Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9636977/
https://www.ncbi.nlm.nih.gov/pubmed/36279463
http://dx.doi.org/10.1073/pnas.2208975119
work_keys_str_mv AT yuchristinalee estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure
AT airoldiedoardom estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure
AT borgschristian estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure
AT chayesjennifert estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure