Cargando…

Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole

We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false posi...

Descripción completa

Detalles Bibliográficos
Autores principales: Steinfath, Matthias, Vogl, Silvia, Violet, Norman, Schwarz, Franziska, Mielke, Hans, Selhorst, Thomas, Greiner, Matthias, Schönfelder, Gilbert
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6135363/
https://www.ncbi.nlm.nih.gov/pubmed/30208060
http://dx.doi.org/10.1371/journal.pone.0202762
_version_ 1783354805412954112
author Steinfath, Matthias
Vogl, Silvia
Violet, Norman
Schwarz, Franziska
Mielke, Hans
Selhorst, Thomas
Greiner, Matthias
Schönfelder, Gilbert
author_facet Steinfath, Matthias
Vogl, Silvia
Violet, Norman
Schwarz, Franziska
Mielke, Hans
Selhorst, Thomas
Greiner, Matthias
Schönfelder, Gilbert
author_sort Steinfath, Matthias
collection PubMed
description We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false positive results, and reducing resource consumption. In contrast to recent publications our model quantifies the impact of each single suggestion not only for an individual study but especially their relation and consequences for the overall scientific process. We can prove that higher-powered experiments can save resources in the overall research process without generating excess false positives. The better the quality of the pre-study information and its exploitation, the more likely this beneficial effect is to occur. Additionally, we quantify the adverse effects of both neglecting good practices in the design and conduct of hypotheses-based research, and the omission of the publication of ‘negative‘ findings. Our contribution is a plea for adherence to or reinforcement of the good scientific practice and publication of ‘negative‘ findings.
format Online
Article
Text
id pubmed-6135363
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-61353632018-09-27 Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole Steinfath, Matthias Vogl, Silvia Violet, Norman Schwarz, Franziska Mielke, Hans Selhorst, Thomas Greiner, Matthias Schönfelder, Gilbert PLoS One Research Article We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false positive results, and reducing resource consumption. In contrast to recent publications our model quantifies the impact of each single suggestion not only for an individual study but especially their relation and consequences for the overall scientific process. We can prove that higher-powered experiments can save resources in the overall research process without generating excess false positives. The better the quality of the pre-study information and its exploitation, the more likely this beneficial effect is to occur. Additionally, we quantify the adverse effects of both neglecting good practices in the design and conduct of hypotheses-based research, and the omission of the publication of ‘negative‘ findings. Our contribution is a plea for adherence to or reinforcement of the good scientific practice and publication of ‘negative‘ findings. Public Library of Science 2018-09-12 /pmc/articles/PMC6135363/ /pubmed/30208060 http://dx.doi.org/10.1371/journal.pone.0202762 Text en © 2018 Steinfath et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Steinfath, Matthias
Vogl, Silvia
Violet, Norman
Schwarz, Franziska
Mielke, Hans
Selhorst, Thomas
Greiner, Matthias
Schönfelder, Gilbert
Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title_full Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title_fullStr Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title_full_unstemmed Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title_short Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
title_sort simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6135363/
https://www.ncbi.nlm.nih.gov/pubmed/30208060
http://dx.doi.org/10.1371/journal.pone.0202762
work_keys_str_mv AT steinfathmatthias simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT voglsilvia simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT violetnorman simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT schwarzfranziska simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT mielkehans simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT selhorstthomas simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT greinermatthias simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole
AT schonfeldergilbert simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole