Cargando…
Beyond ‘significance’: principles and practice of the Analysis of Credibility
The inferential inadequacies of statistical significance testing are now widely recognized. There is, however, no consensus on how to move research into a ‘post p < 0.05’ era. We present a potential route forward via the Analysis of Credibility, a novel methodology that allows researchers to go b...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Royal Society Publishing
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5792895/ https://www.ncbi.nlm.nih.gov/pubmed/29410818 http://dx.doi.org/10.1098/rsos.171047 |
_version_ | 1783296829612359680 |
---|---|
author | Matthews, Robert A. J. |
author_facet | Matthews, Robert A. J. |
author_sort | Matthews, Robert A. J. |
collection | PubMed |
description | The inferential inadequacies of statistical significance testing are now widely recognized. There is, however, no consensus on how to move research into a ‘post p < 0.05’ era. We present a potential route forward via the Analysis of Credibility, a novel methodology that allows researchers to go beyond the simplistic dichotomy of significance testing and extract more insight from new findings. Using standard summary statistics, AnCred assesses the credibility of significant and non-significant findings on the basis of their evidential weight, and in the context of existing knowledge. The outcome is expressed in quantitative terms of direct relevance to the substantive research question, providing greater protection against misinterpretation. Worked examples are given to illustrate how AnCred extracts additional insight from the outcome of typical research study designs. Its ability to cast light on the use of p-values, the interpretation of non-significant findings and the so-called ‘replication crisis’ is also discussed. |
format | Online Article Text |
id | pubmed-5792895 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | The Royal Society Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-57928952018-02-06 Beyond ‘significance’: principles and practice of the Analysis of Credibility Matthews, Robert A. J. R Soc Open Sci Mathematics The inferential inadequacies of statistical significance testing are now widely recognized. There is, however, no consensus on how to move research into a ‘post p < 0.05’ era. We present a potential route forward via the Analysis of Credibility, a novel methodology that allows researchers to go beyond the simplistic dichotomy of significance testing and extract more insight from new findings. Using standard summary statistics, AnCred assesses the credibility of significant and non-significant findings on the basis of their evidential weight, and in the context of existing knowledge. The outcome is expressed in quantitative terms of direct relevance to the substantive research question, providing greater protection against misinterpretation. Worked examples are given to illustrate how AnCred extracts additional insight from the outcome of typical research study designs. Its ability to cast light on the use of p-values, the interpretation of non-significant findings and the so-called ‘replication crisis’ is also discussed. The Royal Society Publishing 2018-01-17 /pmc/articles/PMC5792895/ /pubmed/29410818 http://dx.doi.org/10.1098/rsos.171047 Text en © 2018 The Authors. http://creativecommons.org/licenses/by/4.0/ Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited. |
spellingShingle | Mathematics Matthews, Robert A. J. Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title | Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title_full | Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title_fullStr | Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title_full_unstemmed | Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title_short | Beyond ‘significance’: principles and practice of the Analysis of Credibility |
title_sort | beyond ‘significance’: principles and practice of the analysis of credibility |
topic | Mathematics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5792895/ https://www.ncbi.nlm.nih.gov/pubmed/29410818 http://dx.doi.org/10.1098/rsos.171047 |
work_keys_str_mv | AT matthewsrobertaj beyondsignificanceprinciplesandpracticeoftheanalysisofcredibility |