Cargando…

How feasible is it to abandon statistical significance? A reflection based on a short survey

BACKGROUND: There is a growing trend in using the “statistically significant” term in the scientific literature. However, harsh criticism of this concept motivated the recommendation to withdraw its use of scientific publications. We aimed to validate the support and the feasibility of adherence to...

Descripción completa

Detalles Bibliográficos
Autores principales: Diaz-Quijano, Fredi Alexander, Calixto, Fernando Morelli, da Silva, José Mário Nunes
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7271502/
https://www.ncbi.nlm.nih.gov/pubmed/32493293
http://dx.doi.org/10.1186/s12874-020-01030-x
_version_ 1783542103097212928
author Diaz-Quijano, Fredi Alexander
Calixto, Fernando Morelli
da Silva, José Mário Nunes
author_facet Diaz-Quijano, Fredi Alexander
Calixto, Fernando Morelli
da Silva, José Mário Nunes
author_sort Diaz-Quijano, Fredi Alexander
collection PubMed
description BACKGROUND: There is a growing trend in using the “statistically significant” term in the scientific literature. However, harsh criticism of this concept motivated the recommendation to withdraw its use of scientific publications. We aimed to validate the support and the feasibility of adherence to this recommendation, among researchers having declared in favor of removing the statistical significance. METHODS: We surveyed signatories of an article published that defended this recommendation, to validate their opinion and ask them about how likely they will retire the concept of statistical significance. RESULTS: We obtained 151 responses which confirmed the support for the mentioned publication in aspects such as the adequate interpretation of the p-value, the degree of agreement, and the motivations to sign it. However, there was a wide distribution of answers about how likely are they to use the concept of “statistical significance” in future publications. About 42% declared being neutral, or that would likely use it again. We described arguments referred by several signatories and discussed aspects to be considered in the interpretation of research results. CONCLUSIONS: The responses obtained from a proportion of signatories validated their declared position against the use of statistical significance. However, even in this group, the full application of this recommendation does not seem feasible. The arguments related to the inappropriate use of statistical tests should promote more education among researchers and users of scientific evidence.
format Online
Article
Text
id pubmed-7271502
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-72715022020-06-08 How feasible is it to abandon statistical significance? A reflection based on a short survey Diaz-Quijano, Fredi Alexander Calixto, Fernando Morelli da Silva, José Mário Nunes BMC Med Res Methodol Research Article BACKGROUND: There is a growing trend in using the “statistically significant” term in the scientific literature. However, harsh criticism of this concept motivated the recommendation to withdraw its use of scientific publications. We aimed to validate the support and the feasibility of adherence to this recommendation, among researchers having declared in favor of removing the statistical significance. METHODS: We surveyed signatories of an article published that defended this recommendation, to validate their opinion and ask them about how likely they will retire the concept of statistical significance. RESULTS: We obtained 151 responses which confirmed the support for the mentioned publication in aspects such as the adequate interpretation of the p-value, the degree of agreement, and the motivations to sign it. However, there was a wide distribution of answers about how likely are they to use the concept of “statistical significance” in future publications. About 42% declared being neutral, or that would likely use it again. We described arguments referred by several signatories and discussed aspects to be considered in the interpretation of research results. CONCLUSIONS: The responses obtained from a proportion of signatories validated their declared position against the use of statistical significance. However, even in this group, the full application of this recommendation does not seem feasible. The arguments related to the inappropriate use of statistical tests should promote more education among researchers and users of scientific evidence. BioMed Central 2020-06-03 /pmc/articles/PMC7271502/ /pubmed/32493293 http://dx.doi.org/10.1186/s12874-020-01030-x Text en © The Author(s) 2020 Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Diaz-Quijano, Fredi Alexander
Calixto, Fernando Morelli
da Silva, José Mário Nunes
How feasible is it to abandon statistical significance? A reflection based on a short survey
title How feasible is it to abandon statistical significance? A reflection based on a short survey
title_full How feasible is it to abandon statistical significance? A reflection based on a short survey
title_fullStr How feasible is it to abandon statistical significance? A reflection based on a short survey
title_full_unstemmed How feasible is it to abandon statistical significance? A reflection based on a short survey
title_short How feasible is it to abandon statistical significance? A reflection based on a short survey
title_sort how feasible is it to abandon statistical significance? a reflection based on a short survey
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7271502/
https://www.ncbi.nlm.nih.gov/pubmed/32493293
http://dx.doi.org/10.1186/s12874-020-01030-x
work_keys_str_mv AT diazquijanofredialexander howfeasibleisittoabandonstatisticalsignificanceareflectionbasedonashortsurvey
AT calixtofernandomorelli howfeasibleisittoabandonstatisticalsignificanceareflectionbasedonashortsurvey
AT dasilvajosemarionunes howfeasibleisittoabandonstatisticalsignificanceareflectionbasedonashortsurvey