Cargando…
BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information
Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ign...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403195/ https://www.ncbi.nlm.nih.gov/pubmed/37547410 http://dx.doi.org/10.7717/peerj-cs.1470 |
_version_ | 1785085016064131072 |
---|---|
author | Xu, Bin Li, Shuai Zhang, Zhaowu Liao, Tongxin |
author_facet | Xu, Bin Li, Shuai Zhang, Zhaowu Liao, Tongxin |
author_sort | Xu, Bin |
collection | PubMed |
description | Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ignore the importance of the relative position between entities. Considering the relative position between entity pairs and the influence of sentence level information on the performance of relationship extraction model, this article proposes a BERT-PAGG relationship extraction model. The model introduces the location information of entities, and combines the local features extracted by PAGG module with the entity vector representation output by BERT. Specifically, BERT-PAGG integrates entity location information into local features through segmented convolution neural network, uses attention mechanism to capture more effective semantic features, and finally regulates the transmission of information flow through gating mechanism. Experimental results on two open Chinese relation extraction datasets show that the proposed method achieves the best results compared with other models. At the same time, ablation experiments show that PAGG module can effectively use external information, and the introduction of this module makes the Macro-F1 value of the model increase by at least 2.82%. |
format | Online Article Text |
id | pubmed-10403195 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-104031952023-08-05 BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information Xu, Bin Li, Shuai Zhang, Zhaowu Liao, Tongxin PeerJ Comput Sci Artificial Intelligence Relationship extraction is one of the important tasks of constructing knowledge graph. In recent years, many scholars have introduced external information other than entities into relationship extraction models, which perform better than traditional relationship extraction methods. However, they ignore the importance of the relative position between entities. Considering the relative position between entity pairs and the influence of sentence level information on the performance of relationship extraction model, this article proposes a BERT-PAGG relationship extraction model. The model introduces the location information of entities, and combines the local features extracted by PAGG module with the entity vector representation output by BERT. Specifically, BERT-PAGG integrates entity location information into local features through segmented convolution neural network, uses attention mechanism to capture more effective semantic features, and finally regulates the transmission of information flow through gating mechanism. Experimental results on two open Chinese relation extraction datasets show that the proposed method achieves the best results compared with other models. At the same time, ablation experiments show that PAGG module can effectively use external information, and the introduction of this module makes the Macro-F1 value of the model increase by at least 2.82%. PeerJ Inc. 2023-07-17 /pmc/articles/PMC10403195/ /pubmed/37547410 http://dx.doi.org/10.7717/peerj-cs.1470 Text en ©2023 Xu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited. |
spellingShingle | Artificial Intelligence Xu, Bin Li, Shuai Zhang, Zhaowu Liao, Tongxin BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title | BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title_full | BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title_fullStr | BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title_full_unstemmed | BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title_short | BERT-PAGG: a Chinese relationship extraction model fusing PAGG and entity location information |
title_sort | bert-pagg: a chinese relationship extraction model fusing pagg and entity location information |
topic | Artificial Intelligence |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10403195/ https://www.ncbi.nlm.nih.gov/pubmed/37547410 http://dx.doi.org/10.7717/peerj-cs.1470 |
work_keys_str_mv | AT xubin bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation AT lishuai bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation AT zhangzhaowu bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation AT liaotongxin bertpaggachineserelationshipextractionmodelfusingpaggandentitylocationinformation |