Cargando…
Repeated holdout validation for weighted quantile sum regression
Weighted Quantile Sum (WQS) regression is a method commonly used in environmental epidemiology to assess the impact of chemical mixtures in relation to a health outcome of interest. Data are partitioned into a single training and test set to reduce sample-specific chemical weights. However, in typic...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6911906/ https://www.ncbi.nlm.nih.gov/pubmed/31871919 http://dx.doi.org/10.1016/j.mex.2019.11.008 |
_version_ | 1783479344559030272 |
---|---|
author | Tanner, Eva M. Bornehag, Carl-Gustaf Gennings, Chris |
author_facet | Tanner, Eva M. Bornehag, Carl-Gustaf Gennings, Chris |
author_sort | Tanner, Eva M. |
collection | PubMed |
description | Weighted Quantile Sum (WQS) regression is a method commonly used in environmental epidemiology to assess the impact of chemical mixtures in relation to a health outcome of interest. Data are partitioned into a single training and test set to reduce sample-specific chemical weights. However, in typical epidemiology sample sizes, this may produce unstable chemical weights and WQS index estimates, and investigators may resort to training and testing on the same data. To solve this problem, we propose repeated holdout validation whereby data are randomly partitioned 100 times, producing a distribution of validated results. Taking the mean as the final estimate, confidence estimates may also be calculated for inference. Further, this method helps characterize the variability in chemical weights, aiding in the identification of chemicals of concern. This is important since it may direct future research into specific chemicals. Using data from 718 mother-child pairs in the Swedish Environmental Longitudinal, Mother and Child, Asthma and Allergy (SELMA) study, we assessed the association between prenatal exposure to 26 endocrine disrupting chemicals and child Intelligence Quotient (IQ). Results using a single partition were unstable, varying by random seed. The WQS index estimate was significant when all data was used (e.g. no partition) (β = −2.2 CI = −3.43, −0.98), but attenuated and nonsignificant using repeated holdout validation (β = −0.82 CI = −2.11, 0.45). When implementing WQS in epidemiologic studies with limited sample sizes, repeated holdout validation is a viable alternative to using a single, or no partitioning. Repeated holdout can both stabilize results and help characterize the uncertainty in identifying chemicals of concern, while maintaining some of the the rigor of holdout validation. • Repeated holdout validation improves the stability of WQS estimates in finite study samples; • Uncertainty in identifying toxic chemicals of concern is acknowledged and characterized. |
format | Online Article Text |
id | pubmed-6911906 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-69119062019-12-23 Repeated holdout validation for weighted quantile sum regression Tanner, Eva M. Bornehag, Carl-Gustaf Gennings, Chris MethodsX Environmental Science Weighted Quantile Sum (WQS) regression is a method commonly used in environmental epidemiology to assess the impact of chemical mixtures in relation to a health outcome of interest. Data are partitioned into a single training and test set to reduce sample-specific chemical weights. However, in typical epidemiology sample sizes, this may produce unstable chemical weights and WQS index estimates, and investigators may resort to training and testing on the same data. To solve this problem, we propose repeated holdout validation whereby data are randomly partitioned 100 times, producing a distribution of validated results. Taking the mean as the final estimate, confidence estimates may also be calculated for inference. Further, this method helps characterize the variability in chemical weights, aiding in the identification of chemicals of concern. This is important since it may direct future research into specific chemicals. Using data from 718 mother-child pairs in the Swedish Environmental Longitudinal, Mother and Child, Asthma and Allergy (SELMA) study, we assessed the association between prenatal exposure to 26 endocrine disrupting chemicals and child Intelligence Quotient (IQ). Results using a single partition were unstable, varying by random seed. The WQS index estimate was significant when all data was used (e.g. no partition) (β = −2.2 CI = −3.43, −0.98), but attenuated and nonsignificant using repeated holdout validation (β = −0.82 CI = −2.11, 0.45). When implementing WQS in epidemiologic studies with limited sample sizes, repeated holdout validation is a viable alternative to using a single, or no partitioning. Repeated holdout can both stabilize results and help characterize the uncertainty in identifying chemicals of concern, while maintaining some of the the rigor of holdout validation. • Repeated holdout validation improves the stability of WQS estimates in finite study samples; • Uncertainty in identifying toxic chemicals of concern is acknowledged and characterized. Elsevier 2019-11-22 /pmc/articles/PMC6911906/ /pubmed/31871919 http://dx.doi.org/10.1016/j.mex.2019.11.008 Text en © 2019 The Author(s) http://creativecommons.org/licenses/by-nc-nd/4.0/ This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Environmental Science Tanner, Eva M. Bornehag, Carl-Gustaf Gennings, Chris Repeated holdout validation for weighted quantile sum regression |
title | Repeated holdout validation for weighted quantile sum regression |
title_full | Repeated holdout validation for weighted quantile sum regression |
title_fullStr | Repeated holdout validation for weighted quantile sum regression |
title_full_unstemmed | Repeated holdout validation for weighted quantile sum regression |
title_short | Repeated holdout validation for weighted quantile sum regression |
title_sort | repeated holdout validation for weighted quantile sum regression |
topic | Environmental Science |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6911906/ https://www.ncbi.nlm.nih.gov/pubmed/31871919 http://dx.doi.org/10.1016/j.mex.2019.11.008 |
work_keys_str_mv | AT tannerevam repeatedholdoutvalidationforweightedquantilesumregression AT bornehagcarlgustaf repeatedholdoutvalidationforweightedquantilesumregression AT genningschris repeatedholdoutvalidationforweightedquantilesumregression |