Cargando…

Genetic matching for time-dependent treatments: a longitudinal extension and simulation study

BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine lear...

Descripción completa

Detalles Bibliográficos
Autores principales: Weymann, Deirdre, Chan, Brandon, Regier, Dean A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413721/
https://www.ncbi.nlm.nih.gov/pubmed/37559105
http://dx.doi.org/10.1186/s12874-023-01995-5
_version_ 1785087195502084096
author Weymann, Deirdre
Chan, Brandon
Regier, Dean A.
author_facet Weymann, Deirdre
Chan, Brandon
Regier, Dean A.
author_sort Weymann, Deirdre
collection PubMed
description BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine learning approach that automates balancing of covariate histories. We examine performance by comparing the proposed extension against baseline propensity score matching and time-dependent propensity score matching. METHODS: To evaluate comparative performance, we developed a Monte Carlo simulation framework that reflects a static treatment assigned at multiple time points. Data generation considers a treatment assignment model, a continuous outcome model, and underlying covariates. In simulation, we generated 1,000 datasets, each consisting of 1,000 subjects, and applied: (1) nearest neighbour matching on time-invariant, baseline propensity scores; (2) sequential risk set matching on time-dependent propensity scores; and (3) longitudinal genetic matching on time-dependent covariates. To measure comparative performance, we estimated covariate balance, efficiency, bias, and root mean squared error (RMSE) of treatment effect estimates. In scenario analysis, we varied underlying assumptions for assumed covariate distributions, correlations, treatment assignment models, and outcome models. RESULTS: In all scenarios, baseline propensity score matching resulted in biased effect estimation in the presence of time-dependent confounding, with mean bias ranging from 29.7% to 37.2%. In contrast, time-dependent propensity score matching and longitudinal genetic matching achieved stronger covariate balance and yielded less biased estimation, with mean bias ranging from 0.7% to 13.7%. Across scenarios, longitudinal genetic matching achieved similar or better performance than time-dependent propensity score matching without requiring manual re-specifications or normality of covariates. CONCLUSIONS: While the most appropriate longitudinal method will depend on research questions and underlying data patterns, our study can help guide these decisions. Simulation results demonstrate the validity of our longitudinal genetic matching approach for supporting future real-world assessments of treatments accessible at multiple time points. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12874-023-01995-5.
format Online
Article
Text
id pubmed-10413721
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-104137212023-08-11 Genetic matching for time-dependent treatments: a longitudinal extension and simulation study Weymann, Deirdre Chan, Brandon Regier, Dean A. BMC Med Res Methodol Research BACKGROUND: Longitudinal matching can mitigate confounding in observational, real-world studies of time-dependent treatments. To date, these methods have required iterative, manual re-specifications to achieve covariate balance. We propose a longitudinal extension of genetic matching, a machine learning approach that automates balancing of covariate histories. We examine performance by comparing the proposed extension against baseline propensity score matching and time-dependent propensity score matching. METHODS: To evaluate comparative performance, we developed a Monte Carlo simulation framework that reflects a static treatment assigned at multiple time points. Data generation considers a treatment assignment model, a continuous outcome model, and underlying covariates. In simulation, we generated 1,000 datasets, each consisting of 1,000 subjects, and applied: (1) nearest neighbour matching on time-invariant, baseline propensity scores; (2) sequential risk set matching on time-dependent propensity scores; and (3) longitudinal genetic matching on time-dependent covariates. To measure comparative performance, we estimated covariate balance, efficiency, bias, and root mean squared error (RMSE) of treatment effect estimates. In scenario analysis, we varied underlying assumptions for assumed covariate distributions, correlations, treatment assignment models, and outcome models. RESULTS: In all scenarios, baseline propensity score matching resulted in biased effect estimation in the presence of time-dependent confounding, with mean bias ranging from 29.7% to 37.2%. In contrast, time-dependent propensity score matching and longitudinal genetic matching achieved stronger covariate balance and yielded less biased estimation, with mean bias ranging from 0.7% to 13.7%. Across scenarios, longitudinal genetic matching achieved similar or better performance than time-dependent propensity score matching without requiring manual re-specifications or normality of covariates. CONCLUSIONS: While the most appropriate longitudinal method will depend on research questions and underlying data patterns, our study can help guide these decisions. Simulation results demonstrate the validity of our longitudinal genetic matching approach for supporting future real-world assessments of treatments accessible at multiple time points. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12874-023-01995-5. BioMed Central 2023-08-09 /pmc/articles/PMC10413721/ /pubmed/37559105 http://dx.doi.org/10.1186/s12874-023-01995-5 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Weymann, Deirdre
Chan, Brandon
Regier, Dean A.
Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title_full Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title_fullStr Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title_full_unstemmed Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title_short Genetic matching for time-dependent treatments: a longitudinal extension and simulation study
title_sort genetic matching for time-dependent treatments: a longitudinal extension and simulation study
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10413721/
https://www.ncbi.nlm.nih.gov/pubmed/37559105
http://dx.doi.org/10.1186/s12874-023-01995-5
work_keys_str_mv AT weymanndeirdre geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy
AT chanbrandon geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy
AT regierdeana geneticmatchingfortimedependenttreatmentsalongitudinalextensionandsimulationstudy