Cargando…
A construction and empirical research of the journal disruption index based on open citation data
For many years, the journal evaluation system has been centered on impact indicators, resulting in evaluation results that do not reflect the academic innovation of journals. To solve this issue, this study attempts to construct the Journal Disruption Index (JDI) from the perspective of measuring th...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10195667/ https://www.ncbi.nlm.nih.gov/pubmed/37287879 http://dx.doi.org/10.1007/s11192-023-04737-y |
_version_ | 1785044183772299264 |
---|---|
author | Jiang, Yuyan Liu, Xueli |
author_facet | Jiang, Yuyan Liu, Xueli |
author_sort | Jiang, Yuyan |
collection | PubMed |
description | For many years, the journal evaluation system has been centered on impact indicators, resulting in evaluation results that do not reflect the academic innovation of journals. To solve this issue, this study attempts to construct the Journal Disruption Index (JDI) from the perspective of measuring the disruption of each journal article. In the actual study, we measured the disruption of articles of 22 selected virology journals based on the OpenCitations Index of Crossref open DOI-to-DOI citations (COCI) first. Then we calculated the JDI of 22 virology journals based on the absolute disruption index ([Formula: see text] ) of the articles. Finally, we conducted an empirical study on the differences and correlations between the impact indicators and disruption indicators as well as the evaluation effect of the disruption index. The results of the study show: (1) There are large differences in the ranking of journals based on disruption indicators and impact indicators. Among the 22 journals, 12 are ranked higher by JDI than Cumulative Impact Factor for 5 years (CIF5), the Journal Index for PR6 (JIPR6) and average Percentile in Subject Area (aPSA). The ranking difference of 17 journals between the two kinds of indicators is greater than or equal to 5. (2) There is a medium correlation between disruption indicators and impact indicators at the level of journals and papers. JDI is moderately correlated with CIF5, JIPR6 and aPSA, with correlation coefficients of 0.486, 0.471 and − 0.448, respectively. [Formula: see text] was also moderately correlated with Cumulative Citation (CC), Percentile Ranking with 6 Classifications (PR6) and Percentile in Subject Area (PSA) with correlation coefficients of 0.593, 0.575 and − 0.593, respectively. (3) Compared with traditional impact indicators, the results of journal disruption evaluation are more consistent with the evaluation results of experts’ peer review. JDI reflects the innovation level of journals to a certain extent, which is helpful to promote the evaluation of innovation in sci-tech journals. |
format | Online Article Text |
id | pubmed-10195667 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-101956672023-05-23 A construction and empirical research of the journal disruption index based on open citation data Jiang, Yuyan Liu, Xueli Scientometrics Article For many years, the journal evaluation system has been centered on impact indicators, resulting in evaluation results that do not reflect the academic innovation of journals. To solve this issue, this study attempts to construct the Journal Disruption Index (JDI) from the perspective of measuring the disruption of each journal article. In the actual study, we measured the disruption of articles of 22 selected virology journals based on the OpenCitations Index of Crossref open DOI-to-DOI citations (COCI) first. Then we calculated the JDI of 22 virology journals based on the absolute disruption index ([Formula: see text] ) of the articles. Finally, we conducted an empirical study on the differences and correlations between the impact indicators and disruption indicators as well as the evaluation effect of the disruption index. The results of the study show: (1) There are large differences in the ranking of journals based on disruption indicators and impact indicators. Among the 22 journals, 12 are ranked higher by JDI than Cumulative Impact Factor for 5 years (CIF5), the Journal Index for PR6 (JIPR6) and average Percentile in Subject Area (aPSA). The ranking difference of 17 journals between the two kinds of indicators is greater than or equal to 5. (2) There is a medium correlation between disruption indicators and impact indicators at the level of journals and papers. JDI is moderately correlated with CIF5, JIPR6 and aPSA, with correlation coefficients of 0.486, 0.471 and − 0.448, respectively. [Formula: see text] was also moderately correlated with Cumulative Citation (CC), Percentile Ranking with 6 Classifications (PR6) and Percentile in Subject Area (PSA) with correlation coefficients of 0.593, 0.575 and − 0.593, respectively. (3) Compared with traditional impact indicators, the results of journal disruption evaluation are more consistent with the evaluation results of experts’ peer review. JDI reflects the innovation level of journals to a certain extent, which is helpful to promote the evaluation of innovation in sci-tech journals. Springer International Publishing 2023-05-18 2023 /pmc/articles/PMC10195667/ /pubmed/37287879 http://dx.doi.org/10.1007/s11192-023-04737-y Text en © Akadémiai Kiadó, Budapest, Hungary 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Jiang, Yuyan Liu, Xueli A construction and empirical research of the journal disruption index based on open citation data |
title | A construction and empirical research of the journal disruption index based on open citation data |
title_full | A construction and empirical research of the journal disruption index based on open citation data |
title_fullStr | A construction and empirical research of the journal disruption index based on open citation data |
title_full_unstemmed | A construction and empirical research of the journal disruption index based on open citation data |
title_short | A construction and empirical research of the journal disruption index based on open citation data |
title_sort | construction and empirical research of the journal disruption index based on open citation data |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10195667/ https://www.ncbi.nlm.nih.gov/pubmed/37287879 http://dx.doi.org/10.1007/s11192-023-04737-y |
work_keys_str_mv | AT jiangyuyan aconstructionandempiricalresearchofthejournaldisruptionindexbasedonopencitationdata AT liuxueli aconstructionandempiricalresearchofthejournaldisruptionindexbasedonopencitationdata AT jiangyuyan constructionandempiricalresearchofthejournaldisruptionindexbasedonopencitationdata AT liuxueli constructionandempiricalresearchofthejournaldisruptionindexbasedonopencitationdata |