Cargando…
Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification
Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorpor...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10249838/ https://www.ncbi.nlm.nih.gov/pubmed/37289767 http://dx.doi.org/10.1371/journal.pone.0286915 |
_version_ | 1785055629377798144 |
---|---|
author | Liu, Tao Ke, Zunwang Li, Yanbing Silamu, Wushour |
author_facet | Liu, Tao Ke, Zunwang Li, Yanbing Silamu, Wushour |
author_sort | Liu, Tao |
collection | PubMed |
description | Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model’s ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model’s ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model. |
format | Online Article Text |
id | pubmed-10249838 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-102498382023-06-09 Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification Liu, Tao Ke, Zunwang Li, Yanbing Silamu, Wushour PLoS One Research Article Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model’s ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model’s ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model. Public Library of Science 2023-06-08 /pmc/articles/PMC10249838/ /pubmed/37289767 http://dx.doi.org/10.1371/journal.pone.0286915 Text en © 2023 Liu et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Liu, Tao Ke, Zunwang Li, Yanbing Silamu, Wushour Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title_full | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title_fullStr | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title_full_unstemmed | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title_short | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
title_sort | knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10249838/ https://www.ncbi.nlm.nih.gov/pubmed/37289767 http://dx.doi.org/10.1371/journal.pone.0286915 |
work_keys_str_mv | AT liutao knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT kezunwang knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT liyanbing knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT silamuwushour knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification |