Cargando…

Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis

BACKGROUND: Individual-patient data meta-analysis (IPD-MA) is an increasingly popular approach because of its analytical benefits. IPD-MA of observational studies must overcome the problem of confounding, otherwise biased estimates of treatment effect may be obtained. One approach to reducing confou...

Descripción completa

Detalles Bibliográficos
Autores principales: Johara, Fatema Tuj, Benedetti, Andrea, Platt, Robert, Menzies, Dick, Viiklepp, Piret, Schaaf, Simon, Chan, Edward
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8609730/
https://www.ncbi.nlm.nih.gov/pubmed/34814845
http://dx.doi.org/10.1186/s12874-021-01452-1
_version_ 1784602972156592128
author Johara, Fatema Tuj
Benedetti, Andrea
Platt, Robert
Menzies, Dick
Viiklepp, Piret
Schaaf, Simon
Chan, Edward
author_facet Johara, Fatema Tuj
Benedetti, Andrea
Platt, Robert
Menzies, Dick
Viiklepp, Piret
Schaaf, Simon
Chan, Edward
author_sort Johara, Fatema Tuj
collection PubMed
description BACKGROUND: Individual-patient data meta-analysis (IPD-MA) is an increasingly popular approach because of its analytical benefits. IPD-MA of observational studies must overcome the problem of confounding, otherwise biased estimates of treatment effect may be obtained. One approach to reducing confounding bias could be the use of propensity score matching (PSM). IPD-MA can be considered as two-stage clustered data (patients within studies) and propensity score matching can be implemented within studies, across studies, and combining both. METHODS: This article focuses on implementation of four PSM-based approaches for the analysis of data structure that exploit IPD-MA in two ways: (i) estimation of propensity score model using single-level or random-effects logistic regression; and (ii) matching of propensity scores (PS) across studies, within studies or preferential-within studies. We investigated the performance of these approaches through a simulation study, which considers an IPD-MA that examined the success of different treatments for multidrug-resistant tuberculosis (MDR-TB). The simulation parameters were varied according to three treatment prevalences (according to studies, 50% and 30%), three levels of heterogeneity between studies (low, moderate and high) and three levels of pooled odds ratio (1, 1.5, 3). RESULTS: All approaches showed greater biases at the higher levels of heterogeneity regardless of the choices of treatment prevalences. However, matching of propensity scores using within-study and preferential-within study reported better performance compared to matching across studies when treatment prevalence varied across-studies. For fixed prevalences, a random-effect propensity score model to estimate propensity scores followed by matching of propensity scores across-studies achieved lower biases compared to other PSM-based approaches. CONCLUSIONS: Propensity score matching has wide application in health research while only limited literature is available on the implementation of PSM methods in IPD-MA, and until now methodological performance of PSM methods have not been examined. We believe, this work offers an intuition to the applied researcher for the choice of the PSM-based approaches.
format Online
Article
Text
id pubmed-8609730
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-86097302021-11-23 Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis Johara, Fatema Tuj Benedetti, Andrea Platt, Robert Menzies, Dick Viiklepp, Piret Schaaf, Simon Chan, Edward BMC Med Res Methodol Research Article BACKGROUND: Individual-patient data meta-analysis (IPD-MA) is an increasingly popular approach because of its analytical benefits. IPD-MA of observational studies must overcome the problem of confounding, otherwise biased estimates of treatment effect may be obtained. One approach to reducing confounding bias could be the use of propensity score matching (PSM). IPD-MA can be considered as two-stage clustered data (patients within studies) and propensity score matching can be implemented within studies, across studies, and combining both. METHODS: This article focuses on implementation of four PSM-based approaches for the analysis of data structure that exploit IPD-MA in two ways: (i) estimation of propensity score model using single-level or random-effects logistic regression; and (ii) matching of propensity scores (PS) across studies, within studies or preferential-within studies. We investigated the performance of these approaches through a simulation study, which considers an IPD-MA that examined the success of different treatments for multidrug-resistant tuberculosis (MDR-TB). The simulation parameters were varied according to three treatment prevalences (according to studies, 50% and 30%), three levels of heterogeneity between studies (low, moderate and high) and three levels of pooled odds ratio (1, 1.5, 3). RESULTS: All approaches showed greater biases at the higher levels of heterogeneity regardless of the choices of treatment prevalences. However, matching of propensity scores using within-study and preferential-within study reported better performance compared to matching across studies when treatment prevalence varied across-studies. For fixed prevalences, a random-effect propensity score model to estimate propensity scores followed by matching of propensity scores across-studies achieved lower biases compared to other PSM-based approaches. CONCLUSIONS: Propensity score matching has wide application in health research while only limited literature is available on the implementation of PSM methods in IPD-MA, and until now methodological performance of PSM methods have not been examined. We believe, this work offers an intuition to the applied researcher for the choice of the PSM-based approaches. BioMed Central 2021-11-23 /pmc/articles/PMC8609730/ /pubmed/34814845 http://dx.doi.org/10.1186/s12874-021-01452-1 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Johara, Fatema Tuj
Benedetti, Andrea
Platt, Robert
Menzies, Dick
Viiklepp, Piret
Schaaf, Simon
Chan, Edward
Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title_full Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title_fullStr Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title_full_unstemmed Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title_short Evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
title_sort evaluating the performance of propensity score matching based approaches in individual patient data meta-analysis
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8609730/
https://www.ncbi.nlm.nih.gov/pubmed/34814845
http://dx.doi.org/10.1186/s12874-021-01452-1
work_keys_str_mv AT joharafatematuj evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT benedettiandrea evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT plattrobert evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT menziesdick evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT viiklepppiret evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT schaafsimon evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis
AT chanedward evaluatingtheperformanceofpropensityscorematchingbasedapproachesinindividualpatientdatametaanalysis