_version_ 1784807045501812736
author Zheng, Peng
Afshin, Ashkan
Biryukov, Stan
Bisignano, Catherine
Brauer, Michael
Bryazka, Dana
Burkart, Katrin
Cercy, Kelly M.
Cornaby, Leslie
Dai, Xiaochen
Dirac, M. Ashworth
Estep, Kara
Fay, Kairsten A.
Feldman, Rachel
Ferrari, Alize J.
Gakidou, Emmanuela
Gil, Gabriela Fernanda
Griswold, Max
Hay, Simon I.
He, Jiawei
Irvine, Caleb M. S.
Kassebaum, Nicholas J.
LeGrand, Kate E.
Lescinsky, Haley
Lim, Stephen S.
Lo, Justin
Mullany, Erin C.
Ong, Kanyin Liane
Rao, Puja C.
Razo, Christian
Reitsma, Marissa B.
Roth, Gregory A.
Santomauro, Damian F.
Sorensen, Reed J. D.
Srinivasan, Vinay
Stanaway, Jeffrey D.
Vollset, Stein Emil
Vos, Theo
Wang, Nelson
Welgan, Catherine A.
Wozniak, Sarah S.
Aravkin, Aleksandr Y.
Murray, Christopher J. L.
author_facet Zheng, Peng
Afshin, Ashkan
Biryukov, Stan
Bisignano, Catherine
Brauer, Michael
Bryazka, Dana
Burkart, Katrin
Cercy, Kelly M.
Cornaby, Leslie
Dai, Xiaochen
Dirac, M. Ashworth
Estep, Kara
Fay, Kairsten A.
Feldman, Rachel
Ferrari, Alize J.
Gakidou, Emmanuela
Gil, Gabriela Fernanda
Griswold, Max
Hay, Simon I.
He, Jiawei
Irvine, Caleb M. S.
Kassebaum, Nicholas J.
LeGrand, Kate E.
Lescinsky, Haley
Lim, Stephen S.
Lo, Justin
Mullany, Erin C.
Ong, Kanyin Liane
Rao, Puja C.
Razo, Christian
Reitsma, Marissa B.
Roth, Gregory A.
Santomauro, Damian F.
Sorensen, Reed J. D.
Srinivasan, Vinay
Stanaway, Jeffrey D.
Vollset, Stein Emil
Vos, Theo
Wang, Nelson
Welgan, Catherine A.
Wozniak, Sarah S.
Aravkin, Aleksandr Y.
Murray, Christopher J. L.
author_sort Zheng, Peng
collection PubMed
description Exposure to risks throughout life results in a wide variety of outcomes. Objectively judging the relative impact of these risks on personal and population health is fundamental to individual survival and societal prosperity. Existing mechanisms to quantify and rank the magnitude of these myriad effects and the uncertainty in their estimation are largely subjective, leaving room for interpretation that can fuel academic controversy and add to confusion when communicating risk. We present a new suite of meta-analyses—termed the Burden of Proof studies—designed specifically to help evaluate these methodological issues objectively and quantitatively. Through this data-driven approach that complements existing systems, including GRADE and Cochrane Reviews, we aim to aggregate evidence across multiple studies and enable a quantitative comparison of risk–outcome pairs. We introduce the burden of proof risk function (BPRF), which estimates the level of risk closest to the null hypothesis that is consistent with available data. Here we illustrate the BPRF methodology for the evaluation of four exemplar risk–outcome pairs: smoking and lung cancer, systolic blood pressure and ischemic heart disease, vegetable consumption and ischemic heart disease, and unprocessed red meat consumption and ischemic heart disease. The strength of evidence for each relationship is assessed by computing and summarizing the BPRF, and then translating the summary to a simple star rating. The Burden of Proof methodology provides a consistent way to understand, evaluate and summarize evidence of risk across different risk–outcome pairs, and informs risk analysis conducted as part of the Global Burden of Diseases, Injuries, and Risk Factors Study.
format Online
Article
Text
id pubmed-9556298
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group US
record_format MEDLINE/PubMed
spelling pubmed-95562982022-10-14 The Burden of Proof studies: assessing the evidence of risk Zheng, Peng Afshin, Ashkan Biryukov, Stan Bisignano, Catherine Brauer, Michael Bryazka, Dana Burkart, Katrin Cercy, Kelly M. Cornaby, Leslie Dai, Xiaochen Dirac, M. Ashworth Estep, Kara Fay, Kairsten A. Feldman, Rachel Ferrari, Alize J. Gakidou, Emmanuela Gil, Gabriela Fernanda Griswold, Max Hay, Simon I. He, Jiawei Irvine, Caleb M. S. Kassebaum, Nicholas J. LeGrand, Kate E. Lescinsky, Haley Lim, Stephen S. Lo, Justin Mullany, Erin C. Ong, Kanyin Liane Rao, Puja C. Razo, Christian Reitsma, Marissa B. Roth, Gregory A. Santomauro, Damian F. Sorensen, Reed J. D. Srinivasan, Vinay Stanaway, Jeffrey D. Vollset, Stein Emil Vos, Theo Wang, Nelson Welgan, Catherine A. Wozniak, Sarah S. Aravkin, Aleksandr Y. Murray, Christopher J. L. Nat Med Article Exposure to risks throughout life results in a wide variety of outcomes. Objectively judging the relative impact of these risks on personal and population health is fundamental to individual survival and societal prosperity. Existing mechanisms to quantify and rank the magnitude of these myriad effects and the uncertainty in their estimation are largely subjective, leaving room for interpretation that can fuel academic controversy and add to confusion when communicating risk. We present a new suite of meta-analyses—termed the Burden of Proof studies—designed specifically to help evaluate these methodological issues objectively and quantitatively. Through this data-driven approach that complements existing systems, including GRADE and Cochrane Reviews, we aim to aggregate evidence across multiple studies and enable a quantitative comparison of risk–outcome pairs. We introduce the burden of proof risk function (BPRF), which estimates the level of risk closest to the null hypothesis that is consistent with available data. Here we illustrate the BPRF methodology for the evaluation of four exemplar risk–outcome pairs: smoking and lung cancer, systolic blood pressure and ischemic heart disease, vegetable consumption and ischemic heart disease, and unprocessed red meat consumption and ischemic heart disease. The strength of evidence for each relationship is assessed by computing and summarizing the BPRF, and then translating the summary to a simple star rating. The Burden of Proof methodology provides a consistent way to understand, evaluate and summarize evidence of risk across different risk–outcome pairs, and informs risk analysis conducted as part of the Global Burden of Diseases, Injuries, and Risk Factors Study. Nature Publishing Group US 2022-10-10 2022 /pmc/articles/PMC9556298/ /pubmed/36216935 http://dx.doi.org/10.1038/s41591-022-01973-2 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Zheng, Peng
Afshin, Ashkan
Biryukov, Stan
Bisignano, Catherine
Brauer, Michael
Bryazka, Dana
Burkart, Katrin
Cercy, Kelly M.
Cornaby, Leslie
Dai, Xiaochen
Dirac, M. Ashworth
Estep, Kara
Fay, Kairsten A.
Feldman, Rachel
Ferrari, Alize J.
Gakidou, Emmanuela
Gil, Gabriela Fernanda
Griswold, Max
Hay, Simon I.
He, Jiawei
Irvine, Caleb M. S.
Kassebaum, Nicholas J.
LeGrand, Kate E.
Lescinsky, Haley
Lim, Stephen S.
Lo, Justin
Mullany, Erin C.
Ong, Kanyin Liane
Rao, Puja C.
Razo, Christian
Reitsma, Marissa B.
Roth, Gregory A.
Santomauro, Damian F.
Sorensen, Reed J. D.
Srinivasan, Vinay
Stanaway, Jeffrey D.
Vollset, Stein Emil
Vos, Theo
Wang, Nelson
Welgan, Catherine A.
Wozniak, Sarah S.
Aravkin, Aleksandr Y.
Murray, Christopher J. L.
The Burden of Proof studies: assessing the evidence of risk
title The Burden of Proof studies: assessing the evidence of risk
title_full The Burden of Proof studies: assessing the evidence of risk
title_fullStr The Burden of Proof studies: assessing the evidence of risk
title_full_unstemmed The Burden of Proof studies: assessing the evidence of risk
title_short The Burden of Proof studies: assessing the evidence of risk
title_sort burden of proof studies: assessing the evidence of risk
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9556298/
https://www.ncbi.nlm.nih.gov/pubmed/36216935
http://dx.doi.org/10.1038/s41591-022-01973-2
work_keys_str_mv AT zhengpeng theburdenofproofstudiesassessingtheevidenceofrisk
AT afshinashkan theburdenofproofstudiesassessingtheevidenceofrisk
AT biryukovstan theburdenofproofstudiesassessingtheevidenceofrisk
AT bisignanocatherine theburdenofproofstudiesassessingtheevidenceofrisk
AT brauermichael theburdenofproofstudiesassessingtheevidenceofrisk
AT bryazkadana theburdenofproofstudiesassessingtheevidenceofrisk
AT burkartkatrin theburdenofproofstudiesassessingtheevidenceofrisk
AT cercykellym theburdenofproofstudiesassessingtheevidenceofrisk
AT cornabyleslie theburdenofproofstudiesassessingtheevidenceofrisk
AT daixiaochen theburdenofproofstudiesassessingtheevidenceofrisk
AT diracmashworth theburdenofproofstudiesassessingtheevidenceofrisk
AT estepkara theburdenofproofstudiesassessingtheevidenceofrisk
AT faykairstena theburdenofproofstudiesassessingtheevidenceofrisk
AT feldmanrachel theburdenofproofstudiesassessingtheevidenceofrisk
AT ferrarializej theburdenofproofstudiesassessingtheevidenceofrisk
AT gakidouemmanuela theburdenofproofstudiesassessingtheevidenceofrisk
AT gilgabrielafernanda theburdenofproofstudiesassessingtheevidenceofrisk
AT griswoldmax theburdenofproofstudiesassessingtheevidenceofrisk
AT haysimoni theburdenofproofstudiesassessingtheevidenceofrisk
AT hejiawei theburdenofproofstudiesassessingtheevidenceofrisk
AT irvinecalebms theburdenofproofstudiesassessingtheevidenceofrisk
AT kassebaumnicholasj theburdenofproofstudiesassessingtheevidenceofrisk
AT legrandkatee theburdenofproofstudiesassessingtheevidenceofrisk
AT lescinskyhaley theburdenofproofstudiesassessingtheevidenceofrisk
AT limstephens theburdenofproofstudiesassessingtheevidenceofrisk
AT lojustin theburdenofproofstudiesassessingtheevidenceofrisk
AT mullanyerinc theburdenofproofstudiesassessingtheevidenceofrisk
AT ongkanyinliane theburdenofproofstudiesassessingtheevidenceofrisk
AT raopujac theburdenofproofstudiesassessingtheevidenceofrisk
AT razochristian theburdenofproofstudiesassessingtheevidenceofrisk
AT reitsmamarissab theburdenofproofstudiesassessingtheevidenceofrisk
AT rothgregorya theburdenofproofstudiesassessingtheevidenceofrisk
AT santomaurodamianf theburdenofproofstudiesassessingtheevidenceofrisk
AT sorensenreedjd theburdenofproofstudiesassessingtheevidenceofrisk
AT srinivasanvinay theburdenofproofstudiesassessingtheevidenceofrisk
AT stanawayjeffreyd theburdenofproofstudiesassessingtheevidenceofrisk
AT vollsetsteinemil theburdenofproofstudiesassessingtheevidenceofrisk
AT vostheo theburdenofproofstudiesassessingtheevidenceofrisk
AT wangnelson theburdenofproofstudiesassessingtheevidenceofrisk
AT welgancatherinea theburdenofproofstudiesassessingtheevidenceofrisk
AT wozniaksarahs theburdenofproofstudiesassessingtheevidenceofrisk
AT aravkinaleksandry theburdenofproofstudiesassessingtheevidenceofrisk
AT murraychristopherjl theburdenofproofstudiesassessingtheevidenceofrisk
AT zhengpeng burdenofproofstudiesassessingtheevidenceofrisk
AT afshinashkan burdenofproofstudiesassessingtheevidenceofrisk
AT biryukovstan burdenofproofstudiesassessingtheevidenceofrisk
AT bisignanocatherine burdenofproofstudiesassessingtheevidenceofrisk
AT brauermichael burdenofproofstudiesassessingtheevidenceofrisk
AT bryazkadana burdenofproofstudiesassessingtheevidenceofrisk
AT burkartkatrin burdenofproofstudiesassessingtheevidenceofrisk
AT cercykellym burdenofproofstudiesassessingtheevidenceofrisk
AT cornabyleslie burdenofproofstudiesassessingtheevidenceofrisk
AT daixiaochen burdenofproofstudiesassessingtheevidenceofrisk
AT diracmashworth burdenofproofstudiesassessingtheevidenceofrisk
AT estepkara burdenofproofstudiesassessingtheevidenceofrisk
AT faykairstena burdenofproofstudiesassessingtheevidenceofrisk
AT feldmanrachel burdenofproofstudiesassessingtheevidenceofrisk
AT ferrarializej burdenofproofstudiesassessingtheevidenceofrisk
AT gakidouemmanuela burdenofproofstudiesassessingtheevidenceofrisk
AT gilgabrielafernanda burdenofproofstudiesassessingtheevidenceofrisk
AT griswoldmax burdenofproofstudiesassessingtheevidenceofrisk
AT haysimoni burdenofproofstudiesassessingtheevidenceofrisk
AT hejiawei burdenofproofstudiesassessingtheevidenceofrisk
AT irvinecalebms burdenofproofstudiesassessingtheevidenceofrisk
AT kassebaumnicholasj burdenofproofstudiesassessingtheevidenceofrisk
AT legrandkatee burdenofproofstudiesassessingtheevidenceofrisk
AT lescinskyhaley burdenofproofstudiesassessingtheevidenceofrisk
AT limstephens burdenofproofstudiesassessingtheevidenceofrisk
AT lojustin burdenofproofstudiesassessingtheevidenceofrisk
AT mullanyerinc burdenofproofstudiesassessingtheevidenceofrisk
AT ongkanyinliane burdenofproofstudiesassessingtheevidenceofrisk
AT raopujac burdenofproofstudiesassessingtheevidenceofrisk
AT razochristian burdenofproofstudiesassessingtheevidenceofrisk
AT reitsmamarissab burdenofproofstudiesassessingtheevidenceofrisk
AT rothgregorya burdenofproofstudiesassessingtheevidenceofrisk
AT santomaurodamianf burdenofproofstudiesassessingtheevidenceofrisk
AT sorensenreedjd burdenofproofstudiesassessingtheevidenceofrisk
AT srinivasanvinay burdenofproofstudiesassessingtheevidenceofrisk
AT stanawayjeffreyd burdenofproofstudiesassessingtheevidenceofrisk
AT vollsetsteinemil burdenofproofstudiesassessingtheevidenceofrisk
AT vostheo burdenofproofstudiesassessingtheevidenceofrisk
AT wangnelson burdenofproofstudiesassessingtheevidenceofrisk
AT welgancatherinea burdenofproofstudiesassessingtheevidenceofrisk
AT wozniaksarahs burdenofproofstudiesassessingtheevidenceofrisk
AT aravkinaleksandry burdenofproofstudiesassessingtheevidenceofrisk
AT murraychristopherjl burdenofproofstudiesassessingtheevidenceofrisk