Cargando…
Use of the journal impact factor for assessing individual articles: Statistically flawed or not?
Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
F1000 Research Limited
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7974631/ https://www.ncbi.nlm.nih.gov/pubmed/33796272 http://dx.doi.org/10.12688/f1000research.23418.2 |
_version_ | 1783666933901557760 |
---|---|
author | Waltman, Ludo Traag, Vincent A. |
author_facet | Waltman, Ludo Traag, Vincent A. |
author_sort | Waltman, Ludo |
collection | PubMed |
description | Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor. |
format | Online Article Text |
id | pubmed-7974631 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | F1000 Research Limited |
record_format | MEDLINE/PubMed |
spelling | pubmed-79746312021-03-31 Use of the journal impact factor for assessing individual articles: Statistically flawed or not? Waltman, Ludo Traag, Vincent A. F1000Res Research Article Most scientometricians reject the use of the journal impact factor for assessing individual articles and their authors. The well-known San Francisco Declaration on Research Assessment also strongly objects against this way of using the impact factor. Arguments against the use of the impact factor at the level of individual articles are often based on statistical considerations. The skewness of journal citation distributions typically plays a central role in these arguments. We present a theoretical analysis of statistical arguments against the use of the impact factor at the level of individual articles. Our analysis shows that these arguments do not support the conclusion that the impact factor should not be used for assessing individual articles. Using computer simulations, we demonstrate that under certain conditions the number of citations an article has received is a more accurate indicator of the value of the article than the impact factor. However, under other conditions, the impact factor is a more accurate indicator. It is important to critically discuss the dominant role of the impact factor in research evaluations, but the discussion should not be based on misplaced statistical arguments. Instead, the primary focus should be on the socio-technical implications of the use of the impact factor. F1000 Research Limited 2021-03-01 /pmc/articles/PMC7974631/ /pubmed/33796272 http://dx.doi.org/10.12688/f1000research.23418.2 Text en Copyright: © 2021 Waltman L and Traag VA http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Waltman, Ludo Traag, Vincent A. Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title | Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title_full | Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title_fullStr | Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title_full_unstemmed | Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title_short | Use of the journal impact factor for assessing individual articles: Statistically flawed or not? |
title_sort | use of the journal impact factor for assessing individual articles: statistically flawed or not? |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7974631/ https://www.ncbi.nlm.nih.gov/pubmed/33796272 http://dx.doi.org/10.12688/f1000research.23418.2 |
work_keys_str_mv | AT waltmanludo useofthejournalimpactfactorforassessingindividualarticlesstatisticallyflawedornot AT traagvincenta useofthejournalimpactfactorforassessingindividualarticlesstatisticallyflawedornot |