Cargando…
Estimating the total treatment effect in randomized experiments with unknown network structure
Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider s...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9636977/ https://www.ncbi.nlm.nih.gov/pubmed/36279463 http://dx.doi.org/10.1073/pnas.2208975119 |
_version_ | 1784825075976896512 |
---|---|
author | Yu, Christina Lee Airoldi, Edoardo M. Borgs, Christian Chayes, Jennifer T. |
author_facet | Yu, Christina Lee Airoldi, Edoardo M. Borgs, Christian Chayes, Jennifer T. |
author_sort | Yu, Christina Lee |
collection | PubMed |
description | Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider situations where classical methods for estimating the total treatment effect on a target population are considerably biased due to confounding network effects, i.e., the fact that the treatment of an individual may impact its neighbors’ outcomes, an issue referred to as network interference or as nonindividualized treatment response. A key challenge in these situations is that the network is often unknown and difficult or costly to measure. We assume a potential outcomes model with heterogeneous additive network effects, encompassing a broad class of network interference sources, including spillover, peer effects, and contagion. First, we characterize the limitations in estimating the total treatment effect without knowledge of the network that drives interference. By contrast, we subsequently develop a simple estimator and efficient randomized design that outputs an unbiased estimate with low variance in situations where one is given access to average historical baseline measurements prior to the experiment. Our solution does not require knowledge of the underlying network structure, and it comes with statistical guarantees for a broad class of models. Due to their ease of interpretation and implementation, and their theoretical guarantees, we believe our results will have significant impact on the design of randomized experiments. |
format | Online Article Text |
id | pubmed-9636977 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-96369772022-11-06 Estimating the total treatment effect in randomized experiments with unknown network structure Yu, Christina Lee Airoldi, Edoardo M. Borgs, Christian Chayes, Jennifer T. Proc Natl Acad Sci U S A Physical Sciences Randomized experiments are widely used to estimate the causal effects of a proposed treatment in many areas of science, from medicine and healthcare to the physical and biological sciences, from the social sciences to engineering, and from public policy to the technology industry. Here we consider situations where classical methods for estimating the total treatment effect on a target population are considerably biased due to confounding network effects, i.e., the fact that the treatment of an individual may impact its neighbors’ outcomes, an issue referred to as network interference or as nonindividualized treatment response. A key challenge in these situations is that the network is often unknown and difficult or costly to measure. We assume a potential outcomes model with heterogeneous additive network effects, encompassing a broad class of network interference sources, including spillover, peer effects, and contagion. First, we characterize the limitations in estimating the total treatment effect without knowledge of the network that drives interference. By contrast, we subsequently develop a simple estimator and efficient randomized design that outputs an unbiased estimate with low variance in situations where one is given access to average historical baseline measurements prior to the experiment. Our solution does not require knowledge of the underlying network structure, and it comes with statistical guarantees for a broad class of models. Due to their ease of interpretation and implementation, and their theoretical guarantees, we believe our results will have significant impact on the design of randomized experiments. National Academy of Sciences 2022-10-24 2022-11-01 /pmc/articles/PMC9636977/ /pubmed/36279463 http://dx.doi.org/10.1073/pnas.2208975119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Physical Sciences Yu, Christina Lee Airoldi, Edoardo M. Borgs, Christian Chayes, Jennifer T. Estimating the total treatment effect in randomized experiments with unknown network structure |
title | Estimating the total treatment effect in randomized experiments with unknown network structure |
title_full | Estimating the total treatment effect in randomized experiments with unknown network structure |
title_fullStr | Estimating the total treatment effect in randomized experiments with unknown network structure |
title_full_unstemmed | Estimating the total treatment effect in randomized experiments with unknown network structure |
title_short | Estimating the total treatment effect in randomized experiments with unknown network structure |
title_sort | estimating the total treatment effect in randomized experiments with unknown network structure |
topic | Physical Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9636977/ https://www.ncbi.nlm.nih.gov/pubmed/36279463 http://dx.doi.org/10.1073/pnas.2208975119 |
work_keys_str_mv | AT yuchristinalee estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure AT airoldiedoardom estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure AT borgschristian estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure AT chayesjennifert estimatingthetotaltreatmenteffectinrandomizedexperimentswithunknownnetworkstructure |