Cargando…

BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information

Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ign...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Bin, Li, Shuai, Zhang, Zhaowu, Liao, Tongxin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403195/
https://www.ncbi.nlm.nih.gov/pubmed/37547410
http://dx.doi.org/10.7717/peerj-cs.1470
_version_ 1785085016064131072
author Xu, Bin
Li, Shuai
Zhang, Zhaowu
Liao, Tongxin
author_facet Xu, Bin
Li, Shuai
Zhang, Zhaowu
Liao, Tongxin
author_sort Xu, Bin
collection PubMed
description Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ignore the importance of the relative position between entities. Considering the relative position between entity pairs and the influence of sentence level information on the performance of relationship extraction model, this article proposes a BERT-PAGG relationship extraction model. The model introduces the location information of entities, and combines the local features extracted by PAGG module with the entity vector representation output by BERT. Specifically, BERT-PAGG integrates entity location information into local features through segmented convolution neural network, uses attention mechanism to capture more effective semantic features, and finally regulates the transmission of information flow through gating mechanism. Experimental results on two open Chinese relation extraction datasets show that the proposed method achieves the best results compared with other models. At the same time, ablation experiments show that PAGG module can effectively use external information, and the introduction of this module makes the Macro-F1 value of the model increase by at least 2.82%.
format Online
Article
Text
id pubmed-10403195
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-104031952023-08-05 BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information Xu, Bin Li, Shuai Zhang, Zhaowu Liao, Tongxin PeerJ Comput Sci Artificial Intelligence Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ignore the importance of the relative position between entities. Considering the relative position between entity pairs and the influence of sentence level information on the performance of relationship extraction model, this article proposes a BERT-PAGG relationship extraction model. The model introduces the location information of entities, and combines the local features extracted by PAGG module with the entity vector representation output by BERT. Specifically, BERT-PAGG integrates entity location information into local features through segmented convolution neural network, uses attention mechanism to capture more effective semantic features, and finally regulates the transmission of information flow through gating mechanism. Experimental results on two open Chinese relation extraction datasets show that the proposed method achieves the best results compared with other models. At the same time, ablation experiments show that PAGG module can effectively use external information, and the introduction of this module makes the Macro-F1 value of the model increase by at least 2.82%. PeerJ Inc. 2023-07-17 /pmc/articles/PMC10403195/ /pubmed/37547410 http://dx.doi.org/10.7717/peerj-cs.1470 Text en ©2023 Xu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Artificial Intelligence
Xu, Bin
Li, Shuai
Zhang, Zhaowu
Liao, Tongxin
BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title_full BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title_fullStr BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title_full_unstemmed BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title_short BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
title_sort bert-pagg: a chinese relationship extraction model fusing pagg and entity location information
topic Artificial Intelligence
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403195/
https://www.ncbi.nlm.nih.gov/pubmed/37547410
http://dx.doi.org/10.7717/peerj-cs.1470
work_keys_str_mv AT xubin bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation
AT lishuai bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation
AT zhangzhaowu bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation
AT liaotongxin bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation