Cargando…

The problem with unadjusted multiple and sequential statistical testing

In research studies, the need for additional samples to obtain sufficient statistical power has often to be balanced with the experimental costs. One approach to this end is to sequentially collect data until you have sufficient measurements, e.g., when the p-value drops below 0.05. I outline that t...

Descripción completa

Detalles Bibliográficos
Autor principal: Albers, Casper
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6478696/
https://www.ncbi.nlm.nih.gov/pubmed/31015469
http://dx.doi.org/10.1038/s41467-019-09941-0
_version_ 1783413192036188160
author Albers, Casper
author_facet Albers, Casper
author_sort Albers, Casper
collection PubMed
description In research studies, the need for additional samples to obtain sufficient statistical power has often to be balanced with the experimental costs. One approach to this end is to sequentially collect data until you have sufficient measurements, e.g., when the p-value drops below 0.05. I outline that this approach is common, yet that unadjusted sequential sampling leads to severe statistical issues, such as an inflated rate of false positive findings. As a consequence, the results of such studies are untrustworthy. I identify the statistical methods that can be implemented in order to account for sequential sampling.
format Online
Article
Text
id pubmed-6478696
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-64786962019-04-25 The problem with unadjusted multiple and sequential statistical testing Albers, Casper Nat Commun Comment In research studies, the need for additional samples to obtain sufficient statistical power has often to be balanced with the experimental costs. One approach to this end is to sequentially collect data until you have sufficient measurements, e.g., when the p-value drops below 0.05. I outline that this approach is common, yet that unadjusted sequential sampling leads to severe statistical issues, such as an inflated rate of false positive findings. As a consequence, the results of such studies are untrustworthy. I identify the statistical methods that can be implemented in order to account for sequential sampling. Nature Publishing Group UK 2019-04-23 /pmc/articles/PMC6478696/ /pubmed/31015469 http://dx.doi.org/10.1038/s41467-019-09941-0 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Comment
Albers, Casper
The problem with unadjusted multiple and sequential statistical testing
title The problem with unadjusted multiple and sequential statistical testing
title_full The problem with unadjusted multiple and sequential statistical testing
title_fullStr The problem with unadjusted multiple and sequential statistical testing
title_full_unstemmed The problem with unadjusted multiple and sequential statistical testing
title_short The problem with unadjusted multiple and sequential statistical testing
title_sort problem with unadjusted multiple and sequential statistical testing
topic Comment
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6478696/
https://www.ncbi.nlm.nih.gov/pubmed/31015469
http://dx.doi.org/10.1038/s41467-019-09941-0
work_keys_str_mv AT alberscasper theproblemwithunadjustedmultipleandsequentialstatisticaltesting
AT alberscasper problemwithunadjustedmultipleandsequentialstatisticaltesting