Cargando…

Multi-label classification of research articles using Word2Vec and identification of similarity threshold

Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to i...

Descripción completa

Detalles Bibliográficos
Autores principales: Mustafa, Ghulam, Usman, Muhammad, Yu, Lisu, afzal, Muhammad Tanvir, Sulaiman, Muhammad, Shahid, Abdul
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578475/
https://www.ncbi.nlm.nih.gov/pubmed/34754057
http://dx.doi.org/10.1038/s41598-021-01460-7
_version_ 1784596246779920384
author Mustafa, Ghulam
Usman, Muhammad
Yu, Lisu
afzal, Muhammad Tanvir
Sulaiman, Muhammad
Shahid, Abdul
author_facet Mustafa, Ghulam
Usman, Muhammad
Yu, Lisu
afzal, Muhammad Tanvir
Sulaiman, Muhammad
Shahid, Abdul
author_sort Mustafa, Ghulam
collection PubMed
description Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to inadequate indexing, the resultant documents are largely unstructured. Publicly known systems mostly index the research papers using keywords rather than using subject hierarchy. Numerous methods reported for performing single-label classification (SLC) or multi-label classification (MLC) are based on content and metadata features. Content-based techniques offer higher outcomes due to the extreme richness of features. But the drawback of content-based techniques is the unavailability of full text in most cases. The use of metadata-based parameters, such as title, keywords, and general terms, acts as an alternative to content. However, existing metadata-based techniques indicate low accuracy due to the use of traditional statistical measures to express textual properties in quantitative form, such as BOW, TF, and TFIDF. These measures may not establish the semantic context of the words. The existing MLC techniques require a specified threshold value to map articles into predetermined categories for which domain knowledge is necessary. The objective of this paper is to get over the limitations of SLC and MLC techniques. To capture the semantic and contextual information of words, the suggested approach leverages the Word2Vec paradigm for textual representation. The suggested model determines threshold values using rigorous data analysis, obviating the necessity for domain expertise. Experimentation is carried out on two datasets from the field of computer science (JUCS and ACM). In comparison to current state-of-the-art methodologies, the proposed model performed well. Experiments yielded average accuracy of 0.86 and 0.84 for JUCS and ACM for SLC, and 0.81 and 0.80 for JUCS and ACM for MLC. On both datasets, the proposed SLC model improved the accuracy up to 4%, while the proposed MLC model increased the accuracy up to 3%.
format Online
Article
Text
id pubmed-8578475
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-85784752021-11-10 Multi-label classification of research articles using Word2Vec and identification of similarity threshold Mustafa, Ghulam Usman, Muhammad Yu, Lisu afzal, Muhammad Tanvir Sulaiman, Muhammad Shahid, Abdul Sci Rep Article Every year, around 28,100 journals publish 2.5 million research publications. Search engines, digital libraries, and citation indexes are used extensively to search these publications. When a user submits a query, it generates a large number of documents among which just a few are relevant. Due to inadequate indexing, the resultant documents are largely unstructured. Publicly known systems mostly index the research papers using keywords rather than using subject hierarchy. Numerous methods reported for performing single-label classification (SLC) or multi-label classification (MLC) are based on content and metadata features. Content-based techniques offer higher outcomes due to the extreme richness of features. But the drawback of content-based techniques is the unavailability of full text in most cases. The use of metadata-based parameters, such as title, keywords, and general terms, acts as an alternative to content. However, existing metadata-based techniques indicate low accuracy due to the use of traditional statistical measures to express textual properties in quantitative form, such as BOW, TF, and TFIDF. These measures may not establish the semantic context of the words. The existing MLC techniques require a specified threshold value to map articles into predetermined categories for which domain knowledge is necessary. The objective of this paper is to get over the limitations of SLC and MLC techniques. To capture the semantic and contextual information of words, the suggested approach leverages the Word2Vec paradigm for textual representation. The suggested model determines threshold values using rigorous data analysis, obviating the necessity for domain expertise. Experimentation is carried out on two datasets from the field of computer science (JUCS and ACM). In comparison to current state-of-the-art methodologies, the proposed model performed well. Experiments yielded average accuracy of 0.86 and 0.84 for JUCS and ACM for SLC, and 0.81 and 0.80 for JUCS and ACM for MLC. On both datasets, the proposed SLC model improved the accuracy up to 4%, while the proposed MLC model increased the accuracy up to 3%. Nature Publishing Group UK 2021-11-09 /pmc/articles/PMC8578475/ /pubmed/34754057 http://dx.doi.org/10.1038/s41598-021-01460-7 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Mustafa, Ghulam
Usman, Muhammad
Yu, Lisu
afzal, Muhammad Tanvir
Sulaiman, Muhammad
Shahid, Abdul
Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title_full Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title_fullStr Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title_full_unstemmed Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title_short Multi-label classification of research articles using Word2Vec and identification of similarity threshold
title_sort multi-label classification of research articles using word2vec and identification of similarity threshold
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578475/
https://www.ncbi.nlm.nih.gov/pubmed/34754057
http://dx.doi.org/10.1038/s41598-021-01460-7
work_keys_str_mv AT mustafaghulam multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold
AT usmanmuhammad multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold
AT yulisu multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold
AT afzalmuhammadtanvir multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold
AT sulaimanmuhammad multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold
AT shahidabdul multilabelclassificationofresearcharticlesusingword2vecandidentificationofsimilaritythreshold