Cargando…

A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies

Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed,...

Descripción completa

Detalles Bibliográficos
Autores principales: Cintron, Dakota W., Gottlieb, Laura M., Hagan, Erin, Tan, May Lynn, Vlahov, David, Glymour, M. Maria, Matthay, Ellicott C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9975308/
https://www.ncbi.nlm.nih.gov/pubmed/36873266
http://dx.doi.org/10.1016/j.ssmph.2023.101352
_version_ 1784898847983534080
author Cintron, Dakota W.
Gottlieb, Laura M.
Hagan, Erin
Tan, May Lynn
Vlahov, David
Glymour, M. Maria
Matthay, Ellicott C.
author_facet Cintron, Dakota W.
Gottlieb, Laura M.
Hagan, Erin
Tan, May Lynn
Vlahov, David
Glymour, M. Maria
Matthay, Ellicott C.
author_sort Cintron, Dakota W.
collection PubMed
description Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed, for what subgroups (e.g., male, female), and the subgroup-specific effect estimates expressed as Standardized Mean Differences (SMDs). For each study, outcome, and dimension (e.g., gender), we fit a random-effects meta-analysis. We characterized the magnitude of heterogeneity in policy effects using the standard deviation of the subgroup-specific effect estimates (τ). Among the 44% of studies reporting subgroup-specific estimates, policy effects were generally small (<0.1 SMDs) with mixed impacts on health (67% beneficial) and disparities (50% implied narrowing of disparities). Across study-outcome-dimensions, 54% indicated any heterogeneity in effects, and 20% had τ > 0.1 SMDs. For 26% of study-outcome-dimensions, the magnitude of τ indicated that effects of opposite signs were plausible across subgroups. Heterogeneity was more common in policy effects not specified a priori. Our findings suggest social policies commonly have heterogeneous effects on health of different populations; these HTEs may substantially impact disparities. Studies of social policies and health should routinely evaluate HTEs.
format Online
Article
Text
id pubmed-9975308
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-99753082023-03-02 A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies Cintron, Dakota W. Gottlieb, Laura M. Hagan, Erin Tan, May Lynn Vlahov, David Glymour, M. Maria Matthay, Ellicott C. SSM Popul Health Regular Article Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed, for what subgroups (e.g., male, female), and the subgroup-specific effect estimates expressed as Standardized Mean Differences (SMDs). For each study, outcome, and dimension (e.g., gender), we fit a random-effects meta-analysis. We characterized the magnitude of heterogeneity in policy effects using the standard deviation of the subgroup-specific effect estimates (τ). Among the 44% of studies reporting subgroup-specific estimates, policy effects were generally small (<0.1 SMDs) with mixed impacts on health (67% beneficial) and disparities (50% implied narrowing of disparities). Across study-outcome-dimensions, 54% indicated any heterogeneity in effects, and 20% had τ > 0.1 SMDs. For 26% of study-outcome-dimensions, the magnitude of τ indicated that effects of opposite signs were plausible across subgroups. Heterogeneity was more common in policy effects not specified a priori. Our findings suggest social policies commonly have heterogeneous effects on health of different populations; these HTEs may substantially impact disparities. Studies of social policies and health should routinely evaluate HTEs. Elsevier 2023-02-04 /pmc/articles/PMC9975308/ /pubmed/36873266 http://dx.doi.org/10.1016/j.ssmph.2023.101352 Text en © 2023 The Authors. Published by Elsevier Ltd. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Regular Article
Cintron, Dakota W.
Gottlieb, Laura M.
Hagan, Erin
Tan, May Lynn
Vlahov, David
Glymour, M. Maria
Matthay, Ellicott C.
A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title_full A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title_fullStr A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title_full_unstemmed A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title_short A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
title_sort quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
topic Regular Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9975308/
https://www.ncbi.nlm.nih.gov/pubmed/36873266
http://dx.doi.org/10.1016/j.ssmph.2023.101352
work_keys_str_mv AT cintrondakotaw aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT gottlieblauram aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT haganerin aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT tanmaylynn aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT vlahovdavid aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT glymourmmaria aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT matthayellicottc aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT cintrondakotaw quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT gottlieblauram quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT haganerin quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT tanmaylynn quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT vlahovdavid quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT glymourmmaria quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies
AT matthayellicottc quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies