Cargando…

Use of the journal impact factor for assessing individual articles: Statistically flawed or not?

Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at...

Descripción completa

Detalles Bibliográficos
Autores principales: Waltman, Ludo, Traag, Vincent A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: F1000 Research Limited 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7974631/
https://www.ncbi.nlm.nih.gov/pubmed/33796272
http://dx.doi.org/10.12688/f1000research.23418.2
_version_ 1783666933901557760
author Waltman, Ludo
Traag, Vincent A.
author_facet Waltman, Ludo
Traag, Vincent A.
author_sort Waltman, Ludo
collection PubMed
description Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor.
format Online
Article
Text
id pubmed-7974631
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher F1000 Research Limited
record_format MEDLINE/PubMed
spelling pubmed-79746312021-03-31 Use of the journal impact factor for assessing individual articles: Statistically flawed or not? Waltman, Ludo Traag, Vincent A. F1000Res Research Article Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor. F1000 Research Limited 2021-03-01 /pmc/articles/PMC7974631/ /pubmed/33796272 http://dx.doi.org/10.12688/f1000research.23418.2 Text en Copyright: © 2021 Waltman L and Traag VA http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Waltman, Ludo
Traag, Vincent A.
Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title_full Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title_fullStr Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title_full_unstemmed Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title_short Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
title_sort use of the journal impact factor for assessing individual articles: statistically flawed or not?
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7974631/
https://www.ncbi.nlm.nih.gov/pubmed/33796272
http://dx.doi.org/10.12688/f1000research.23418.2
work_keys_str_mv AT waltmanludo useofthejournalimpactfactorforassessingindividualarticlesstatisticallyflawedornot
AT traagvincenta useofthejournalimpactfactorforassessingindividualarticlesstatisticallyflawedornot