Cargando…
Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine lear...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413721/ https://www.ncbi.nlm.nih.gov/pubmed/37559105 http://dx.doi.org/10.1186/s12874-023-01995-5 |
_version_ | 1785087195502084096 |
---|---|
author | Weymann, Deirdre Chan, Brandon Regier, Dean A. |
author_facet | Weymann, Deirdre Chan, Brandon Regier, Dean A. |
author_sort | Weymann, Deirdre |
collection | PubMed |
description | BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine learning approach that automates balancing of covariate histories. We examine performance by comparing the proposed extension against baseline propensity score matching and time-dependent propensity score matching. METHODS: To evaluate comparative performance, we developed a Monte Carlo simulation framework that reflects a static treatment assigned at multiple time points. Data generation considers a treatment assignment model, a continuous outcome model, and underlying covariates. In simulation, we generated 1,000 datasets, each consisting of 1,000 subjects, and applied: (1) nearest neighbour matching on time-invariant, baseline propensity scores; (2) sequential risk set matching on time-dependent propensity scores; and (3) longitudinal genetic matching on time-dependent covariates. To measure comparative performance, we estimated covariate balance, efficiency, bias, and root mean squared error (RMSE) of treatment effect estimates. In scenario analysis, we varied underlying assumptions for assumed covariate distributions, correlations, treatment assignment models, and outcome models. RESULTS: In all scenarios, baseline propensity score matching resulted in biased effect estimation in the presence of time-dependent confounding, with mean bias ranging from 29.7% to 37.2%. In contrast, time-dependent propensity score matching and longitudinal genetic matching achieved stronger covariate balance and yielded less biased estimation, with mean bias ranging from 0.7% to 13.7%. Across scenarios, longitudinal genetic matching achieved similar or better performance than time-dependent propensity score matching without requiring manual re-specifications or normality of covariates. CONCLUSIONS: While the most appropriate longitudinal method will depend on research questions and underlying data patterns, our study can help guide these decisions. Simulation results demonstrate the validity of our longitudinal genetic matching approach for supporting future real-world assessments of treatments accessible at multiple time points. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12874-023-01995-5. |
format | Online Article Text |
id | pubmed-10413721 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-104137212023-08-11 Genetic matching for time-dependent treatments: a longitudinal extension and simulation study Weymann, Deirdre Chan, Brandon Regier, Dean A. BMC Med Res Methodol Research BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine learning approach that automates balancing of covariate histories. We examine performance by comparing the proposed extension against baseline propensity score matching and time-dependent propensity score matching. METHODS: To evaluate comparative performance, we developed a Monte Carlo simulation framework that reflects a static treatment assigned at multiple time points. Data generation considers a treatment assignment model, a continuous outcome model, and underlying covariates. In simulation, we generated 1,000 datasets, each consisting of 1,000 subjects, and applied: (1) nearest neighbour matching on time-invariant, baseline propensity scores; (2) sequential risk set matching on time-dependent propensity scores; and (3) longitudinal genetic matching on time-dependent covariates. To measure comparative performance, we estimated covariate balance, efficiency, bias, and root mean squared error (RMSE) of treatment effect estimates. In scenario analysis, we varied underlying assumptions for assumed covariate distributions, correlations, treatment assignment models, and outcome models. RESULTS: In all scenarios, baseline propensity score matching resulted in biased effect estimation in the presence of time-dependent confounding, with mean bias ranging from 29.7% to 37.2%. In contrast, time-dependent propensity score matching and longitudinal genetic matching achieved stronger covariate balance and yielded less biased estimation, with mean bias ranging from 0.7% to 13.7%. Across scenarios, longitudinal genetic matching achieved similar or better performance than time-dependent propensity score matching without requiring manual re-specifications or normality of covariates. CONCLUSIONS: While the most appropriate longitudinal method will depend on research questions and underlying data patterns, our study can help guide these decisions. Simulation results demonstrate the validity of our longitudinal genetic matching approach for supporting future real-world assessments of treatments accessible at multiple time points. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12874-023-01995-5. BioMed Central 2023-08-09 /pmc/articles/PMC10413721/ /pubmed/37559105 http://dx.doi.org/10.1186/s12874-023-01995-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Weymann, Deirdre Chan, Brandon Regier, Dean A. Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title | Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title_full | Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title_fullStr | Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title_full_unstemmed | Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title_short | Genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
title_sort | genetic matching for time-dependent treatments: a longitudinal extension and simulation study |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413721/ https://www.ncbi.nlm.nih.gov/pubmed/37559105 http://dx.doi.org/10.1186/s12874-023-01995-5 |
work_keys_str_mv | AT weymanndeirdre geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy AT chanbrandon geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy AT regierdeana geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy |