Cargando…
A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies
Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed,...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9975308/ https://www.ncbi.nlm.nih.gov/pubmed/36873266 http://dx.doi.org/10.1016/j.ssmph.2023.101352 |
_version_ | 1784898847983534080 |
---|---|
author | Cintron, Dakota W. Gottlieb, Laura M. Hagan, Erin Tan, May Lynn Vlahov, David Glymour, M. Maria Matthay, Ellicott C. |
author_facet | Cintron, Dakota W. Gottlieb, Laura M. Hagan, Erin Tan, May Lynn Vlahov, David Glymour, M. Maria Matthay, Ellicott C. |
author_sort | Cintron, Dakota W. |
collection | PubMed |
description | Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed, for what subgroups (e.g., male, female), and the subgroup-specific effect estimates expressed as Standardized Mean Differences (SMDs). For each study, outcome, and dimension (e.g., gender), we fit a random-effects meta-analysis. We characterized the magnitude of heterogeneity in policy effects using the standard deviation of the subgroup-specific effect estimates (τ). Among the 44% of studies reporting subgroup-specific estimates, policy effects were generally small (<0.1 SMDs) with mixed impacts on health (67% beneficial) and disparities (50% implied narrowing of disparities). Across study-outcome-dimensions, 54% indicated any heterogeneity in effects, and 20% had τ > 0.1 SMDs. For 26% of study-outcome-dimensions, the magnitude of τ indicated that effects of opposite signs were plausible across subgroups. Heterogeneity was more common in policy effects not specified a priori. Our findings suggest social policies commonly have heterogeneous effects on health of different populations; these HTEs may substantially impact disparities. Studies of social policies and health should routinely evaluate HTEs. |
format | Online Article Text |
id | pubmed-9975308 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-99753082023-03-02 A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies Cintron, Dakota W. Gottlieb, Laura M. Hagan, Erin Tan, May Lynn Vlahov, David Glymour, M. Maria Matthay, Ellicott C. SSM Popul Health Regular Article Substantial heterogeneity in effects of social policies on health across subgroups may be common, but has not been systematically characterized. Using a sample of 55 contemporary studies on health effects of social policies, we recorded how often heterogeneous treatment effects (HTEs) were assessed, for what subgroups (e.g., male, female), and the subgroup-specific effect estimates expressed as Standardized Mean Differences (SMDs). For each study, outcome, and dimension (e.g., gender), we fit a random-effects meta-analysis. We characterized the magnitude of heterogeneity in policy effects using the standard deviation of the subgroup-specific effect estimates (τ). Among the 44% of studies reporting subgroup-specific estimates, policy effects were generally small (<0.1 SMDs) with mixed impacts on health (67% beneficial) and disparities (50% implied narrowing of disparities). Across study-outcome-dimensions, 54% indicated any heterogeneity in effects, and 20% had τ > 0.1 SMDs. For 26% of study-outcome-dimensions, the magnitude of τ indicated that effects of opposite signs were plausible across subgroups. Heterogeneity was more common in policy effects not specified a priori. Our findings suggest social policies commonly have heterogeneous effects on health of different populations; these HTEs may substantially impact disparities. Studies of social policies and health should routinely evaluate HTEs. Elsevier 2023-02-04 /pmc/articles/PMC9975308/ /pubmed/36873266 http://dx.doi.org/10.1016/j.ssmph.2023.101352 Text en © 2023 The Authors. Published by Elsevier Ltd. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Regular Article Cintron, Dakota W. Gottlieb, Laura M. Hagan, Erin Tan, May Lynn Vlahov, David Glymour, M. Maria Matthay, Ellicott C. A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title | A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title_full | A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title_fullStr | A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title_full_unstemmed | A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title_short | A quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
title_sort | quantitative assessment of the frequency and magnitude of heterogeneous treatment effects in studies of the health effects of social policies |
topic | Regular Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9975308/ https://www.ncbi.nlm.nih.gov/pubmed/36873266 http://dx.doi.org/10.1016/j.ssmph.2023.101352 |
work_keys_str_mv | AT cintrondakotaw aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT gottlieblauram aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT haganerin aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT tanmaylynn aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT vlahovdavid aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT glymourmmaria aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT matthayellicottc aquantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT cintrondakotaw quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT gottlieblauram quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT haganerin quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT tanmaylynn quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT vlahovdavid quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT glymourmmaria quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies AT matthayellicottc quantitativeassessmentofthefrequencyandmagnitudeofheterogeneoustreatmenteffectsinstudiesofthehealtheffectsofsocialpolicies |