Cargando…

Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification

Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorpor...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Tao, Ke, Zunwang, Li, Yanbing, Silamu, Wushour
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10249838/
https://www.ncbi.nlm.nih.gov/pubmed/37289767
http://dx.doi.org/10.1371/journal.pone.0286915
_version_ 1785055629377798144
author Liu, Tao
Ke, Zunwang
Li, Yanbing
Silamu, Wushour
author_facet Liu, Tao
Ke, Zunwang
Li, Yanbing
Silamu, Wushour
author_sort Liu, Tao
collection PubMed
description Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model’s ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model’s ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model.
format Online
Article
Text
id pubmed-10249838
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-102498382023-06-09 Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification Liu, Tao Ke, Zunwang Li, Yanbing Silamu, Wushour PLoS One Research Article Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model’s ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model’s ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model. Public Library of Science 2023-06-08 /pmc/articles/PMC10249838/ /pubmed/37289767 http://dx.doi.org/10.1371/journal.pone.0286915 Text en © 2023 Liu et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Liu, Tao
Ke, Zunwang
Li, Yanbing
Silamu, Wushour
Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title_full Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title_fullStr Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title_full_unstemmed Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title_short Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
title_sort knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10249838/
https://www.ncbi.nlm.nih.gov/pubmed/37289767
http://dx.doi.org/10.1371/journal.pone.0286915
work_keys_str_mv AT liutao knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification
AT kezunwang knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification
AT liyanbing knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification
AT silamuwushour knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification