Cargando…

Bayes factor functions for reporting outcomes of hypothesis tests

Bayes factors represent a useful alternative to P-values for reporting outcomes of hypothesis tests by providing direct measures of the relative support that data provide to competing hypotheses. Unfortunately, the competing hypotheses have to be specified, and the calculation of Bayes factors in hi...

Descripción completa

Detalles Bibliográficos
Autores principales: Johnson, Valen E., Pramanik, Sandipan, Shudde, Rachael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9974512/
https://www.ncbi.nlm.nih.gov/pubmed/36780516
http://dx.doi.org/10.1073/pnas.2217331120
_version_ 1784898745594281984
author Johnson, Valen E.
Pramanik, Sandipan
Shudde, Rachael
author_facet Johnson, Valen E.
Pramanik, Sandipan
Shudde, Rachael
author_sort Johnson, Valen E.
collection PubMed
description Bayes factors represent a useful alternative to P-values for reporting outcomes of hypothesis tests by providing direct measures of the relative support that data provide to competing hypotheses. Unfortunately, the competing hypotheses have to be specified, and the calculation of Bayes factors in high-dimensional settings can be difficult. To address these problems, we define Bayes factor functions (BFFs) directly from common test statistics. BFFs depend on a single noncentrality parameter that can be expressed as a function of standardized effects, and plots of BFFs versus effect size provide informative summaries of hypothesis tests that can be easily aggregated across studies. Such summaries eliminate the need for arbitrary P-value thresholds to define “statistical significance.” Because BFFs are defined using nonlocal alternative prior densities, they provide more rapid accumulation of evidence in favor of true null hypotheses without sacrificing efficiency in supporting true alternative hypotheses. BFFs can be expressed in closed form and can be computed easily from z, t, χ(2), and F statistics.
format Online
Article
Text
id pubmed-9974512
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-99745122023-03-02 Bayes factor functions for reporting outcomes of hypothesis tests Johnson, Valen E. Pramanik, Sandipan Shudde, Rachael Proc Natl Acad Sci U S A Physical Sciences Bayes factors represent a useful alternative to P-values for reporting outcomes of hypothesis tests by providing direct measures of the relative support that data provide to competing hypotheses. Unfortunately, the competing hypotheses have to be specified, and the calculation of Bayes factors in high-dimensional settings can be difficult. To address these problems, we define Bayes factor functions (BFFs) directly from common test statistics. BFFs depend on a single noncentrality parameter that can be expressed as a function of standardized effects, and plots of BFFs versus effect size provide informative summaries of hypothesis tests that can be easily aggregated across studies. Such summaries eliminate the need for arbitrary P-value thresholds to define “statistical significance.” Because BFFs are defined using nonlocal alternative prior densities, they provide more rapid accumulation of evidence in favor of true null hypotheses without sacrificing efficiency in supporting true alternative hypotheses. BFFs can be expressed in closed form and can be computed easily from z, t, χ(2), and F statistics. National Academy of Sciences 2023-02-13 2023-02-21 /pmc/articles/PMC9974512/ /pubmed/36780516 http://dx.doi.org/10.1073/pnas.2217331120 Text en Copyright © 2023 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Physical Sciences
Johnson, Valen E.
Pramanik, Sandipan
Shudde, Rachael
Bayes factor functions for reporting outcomes of hypothesis tests
title Bayes factor functions for reporting outcomes of hypothesis tests
title_full Bayes factor functions for reporting outcomes of hypothesis tests
title_fullStr Bayes factor functions for reporting outcomes of hypothesis tests
title_full_unstemmed Bayes factor functions for reporting outcomes of hypothesis tests
title_short Bayes factor functions for reporting outcomes of hypothesis tests
title_sort bayes factor functions for reporting outcomes of hypothesis tests
topic Physical Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9974512/
https://www.ncbi.nlm.nih.gov/pubmed/36780516
http://dx.doi.org/10.1073/pnas.2217331120
work_keys_str_mv AT johnsonvalene bayesfactorfunctionsforreportingoutcomesofhypothesistests
AT pramaniksandipan bayesfactorfunctionsforreportingoutcomesofhypothesistests
AT shudderachael bayesfactorfunctionsforreportingoutcomesofhypothesistests