Cargando…
Multi-label classification of research articles using Word2Vec and identification of similarity threshold
Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to i...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578475/ https://www.ncbi.nlm.nih.gov/pubmed/34754057 http://dx.doi.org/10.1038/s41598-021-01460-7 |
_version_ | 1784596246779920384 |
---|---|
author | Mustafa, Ghulam Usman, Muhammad Yu, Lisu afzal, Muhammad Tanvir Sulaiman, Muhammad Shahid, Abdul |
author_facet | Mustafa, Ghulam Usman, Muhammad Yu, Lisu afzal, Muhammad Tanvir Sulaiman, Muhammad Shahid, Abdul |
author_sort | Mustafa, Ghulam |
collection | PubMed |
description | Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to inadequate indexing, the resultant documents are largely unstructured. Publicly known systems mostly index the research papers using keywords rather than using subject hierarchy. Numerous methods reported for performing single-label classification (SLC) or multi-label classification (MLC) are based on content and metadata features. Content-based techniques offer higher outcomes due to the extreme richness of features. But the drawback of content-based techniques is the unavailability of full text in most cases. The use of metadata-based parameters, such as title, keywords, and general terms, acts as an alternative to content. However, existing metadata-based techniques indicate low accuracy due to the use of traditional statistical measures to express textual properties in quantitative form, such as BOW, TF, and TFIDF. These measures may not establish the semantic context of the words. The existing MLC techniques require a specified threshold value to map articles into predetermined categories for which domain knowledge is necessary. The objective of this paper is to get over the limitations of SLC and MLC techniques. To capture the semantic and contextual information of words, the suggested approach leverages the Word2Vec paradigm for textual representation. The suggested model determines threshold values using rigorous data analysis, obviating the necessity for domain expertise. Experimentation is carried out on two datasets from the field of computer science (JUCS and ACM). In comparison to current state-of-the-art methodologies, the proposed model performed well. Experiments yielded average accuracy of 0.86 and 0.84 for JUCS and ACM for SLC, and 0.81 and 0.80 for JUCS and ACM for MLC. On both datasets, the proposed SLC model improved the accuracy up to 4%, while the proposed MLC model increased the accuracy up to 3%. |
format | Online Article Text |
id | pubmed-8578475 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-85784752021-11-10 Multi-label classification of research articles using Word2Vec and identification of similarity threshold Mustafa, Ghulam Usman, Muhammad Yu, Lisu afzal, Muhammad Tanvir Sulaiman, Muhammad Shahid, Abdul Sci Rep Article Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to inadequate indexing, the resultant documents are largely unstructured. Publicly known systems mostly index the research papers using keywords rather than using subject hierarchy. Numerous methods reported for performing single-label classification (SLC) or multi-label classification (MLC) are based on content and metadata features. Content-based techniques offer higher outcomes due to the extreme richness of features. But the drawback of content-based techniques is the unavailability of full text in most cases. The use of metadata-based parameters, such as title, keywords, and general terms, acts as an alternative to content. However, existing metadata-based techniques indicate low accuracy due to the use of traditional statistical measures to express textual properties in quantitative form, such as BOW, TF, and TFIDF. These measures may not establish the semantic context of the words. The existing MLC techniques require a specified threshold value to map articles into predetermined categories for which domain knowledge is necessary. The objective of this paper is to get over the limitations of SLC and MLC techniques. To capture the semantic and contextual information of words, the suggested approach leverages the Word2Vec paradigm for textual representation. The suggested model determines threshold values using rigorous data analysis, obviating the necessity for domain expertise. Experimentation is carried out on two datasets from the field of computer science (JUCS and ACM). In comparison to current state-of-the-art methodologies, the proposed model performed well. Experiments yielded average accuracy of 0.86 and 0.84 for JUCS and ACM for SLC, and 0.81 and 0.80 for JUCS and ACM for MLC. On both datasets, the proposed SLC model improved the accuracy up to 4%, while the proposed MLC model increased the accuracy up to 3%. Nature Publishing Group UK 2021-11-09 /pmc/articles/PMC8578475/ /pubmed/34754057 http://dx.doi.org/10.1038/s41598-021-01460-7 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Mustafa, Ghulam Usman, Muhammad Yu, Lisu afzal, Muhammad Tanvir Sulaiman, Muhammad Shahid, Abdul Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title | Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title_full | Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title_fullStr | Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title_full_unstemmed | Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title_short | Multi-label classification of research articles using Word2Vec and identification of similarity threshold |
title_sort | multi-label classification of research articles using word2vec and identification of similarity threshold |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578475/ https://www.ncbi.nlm.nih.gov/pubmed/34754057 http://dx.doi.org/10.1038/s41598-021-01460-7 |
work_keys_str_mv | AT mustafaghulam multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold AT usmanmuhammad multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold AT yulisu multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold AT afzalmuhammadtanvir multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold AT sulaimanmuhammad multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold AT shahidabdul multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold |