Cargando…
Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false posi...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6135363/ https://www.ncbi.nlm.nih.gov/pubmed/30208060 http://dx.doi.org/10.1371/journal.pone.0202762 |
_version_ | 1783354805412954112 |
---|---|
author | Steinfath, Matthias Vogl, Silvia Violet, Norman Schwarz, Franziska Mielke, Hans Selhorst, Thomas Greiner, Matthias Schönfelder, Gilbert |
author_facet | Steinfath, Matthias Vogl, Silvia Violet, Norman Schwarz, Franziska Mielke, Hans Selhorst, Thomas Greiner, Matthias Schönfelder, Gilbert |
author_sort | Steinfath, Matthias |
collection | PubMed |
description | We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false positive results, and reducing resource consumption. In contrast to recent publications our model quantifies the impact of each single suggestion not only for an individual study but especially their relation and consequences for the overall scientific process. We can prove that higher-powered experiments can save resources in the overall research process without generating excess false positives. The better the quality of the pre-study information and its exploitation, the more likely this beneficial effect is to occur. Additionally, we quantify the adverse effects of both neglecting good practices in the design and conduct of hypotheses-based research, and the omission of the publication of ‘negative‘ findings. Our contribution is a plea for adherence to or reinforcement of the good scientific practice and publication of ‘negative‘ findings. |
format | Online Article Text |
id | pubmed-6135363 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-61353632018-09-27 Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole Steinfath, Matthias Vogl, Silvia Violet, Norman Schwarz, Franziska Mielke, Hans Selhorst, Thomas Greiner, Matthias Schönfelder, Gilbert PLoS One Research Article We developed a new probabilistic model to assess the impact of recommendations rectifying the reproducibility crisis (by publishing both positive and ‘negative‘ results and increasing statistical power) on competing objectives, such as discovering causal relationships, avoiding publishing false positive results, and reducing resource consumption. In contrast to recent publications our model quantifies the impact of each single suggestion not only for an individual study but especially their relation and consequences for the overall scientific process. We can prove that higher-powered experiments can save resources in the overall research process without generating excess false positives. The better the quality of the pre-study information and its exploitation, the more likely this beneficial effect is to occur. Additionally, we quantify the adverse effects of both neglecting good practices in the design and conduct of hypotheses-based research, and the omission of the publication of ‘negative‘ findings. Our contribution is a plea for adherence to or reinforcement of the good scientific practice and publication of ‘negative‘ findings. Public Library of Science 2018-09-12 /pmc/articles/PMC6135363/ /pubmed/30208060 http://dx.doi.org/10.1371/journal.pone.0202762 Text en © 2018 Steinfath et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Steinfath, Matthias Vogl, Silvia Violet, Norman Schwarz, Franziska Mielke, Hans Selhorst, Thomas Greiner, Matthias Schönfelder, Gilbert Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title | Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title_full | Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title_fullStr | Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title_full_unstemmed | Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title_short | Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
title_sort | simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6135363/ https://www.ncbi.nlm.nih.gov/pubmed/30208060 http://dx.doi.org/10.1371/journal.pone.0202762 |
work_keys_str_mv | AT steinfathmatthias simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT voglsilvia simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT violetnorman simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT schwarzfranziska simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT mielkehans simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT selhorstthomas simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT greinermatthias simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole AT schonfeldergilbert simplechangesofindividualstudiescanimprovethereproducibilityofthebiomedicalscientificprocessasawhole |