Cargando…
A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453911/ https://www.ncbi.nlm.nih.gov/pubmed/37628247 http://dx.doi.org/10.3390/e25081217 |
_version_ | 1785096060124790784 |
---|---|
author | Liao, Tao Sun, Haojie Zhang, Shunxiang |
author_facet | Liao, Tao Sun, Haojie Zhang, Shunxiang |
author_sort | Liao, Tao |
collection | PubMed |
description | The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship extraction model based on the span and a cascaded dual decoding. The model includes a Bidirectional Encoder Representations from Transformers (BERT) encoding layer, a relational decoding layer, and an entity decoding layer. The model first converts the text input into the BERT pretrained language model into word vectors. Then, it divides the word vectors based on the span to form a span sequence and decodes the relationship between the span sequence to obtain the relationship type in the span sequence. Finally, the entity decoding layer fuses the span sequences and the relationship type obtained by relation decoding and uses a bi-directional long short-term memory (Bi-LSTM) neural network to obtain the head entity and tail entity in the span sequence. Using the combination of span division and cascaded double decoding, the overlapping relations existing in the text can be effectively identified. Experiments show that compared with other baseline models, the F1 value of the model is effectively improved on the NYT dataset and WebNLG dataset. |
format | Online Article Text |
id | pubmed-10453911 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104539112023-08-26 A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding Liao, Tao Sun, Haojie Zhang, Shunxiang Entropy (Basel) Article The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship extraction model based on the span and a cascaded dual decoding. The model includes a Bidirectional Encoder Representations from Transformers (BERT) encoding layer, a relational decoding layer, and an entity decoding layer. The model first converts the text input into the BERT pretrained language model into word vectors. Then, it divides the word vectors based on the span to form a span sequence and decodes the relationship between the span sequence to obtain the relationship type in the span sequence. Finally, the entity decoding layer fuses the span sequences and the relationship type obtained by relation decoding and uses a bi-directional long short-term memory (Bi-LSTM) neural network to obtain the head entity and tail entity in the span sequence. Using the combination of span division and cascaded double decoding, the overlapping relations existing in the text can be effectively identified. Experiments show that compared with other baseline models, the F1 value of the model is effectively improved on the NYT dataset and WebNLG dataset. MDPI 2023-08-16 /pmc/articles/PMC10453911/ /pubmed/37628247 http://dx.doi.org/10.3390/e25081217 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Liao, Tao Sun, Haojie Zhang, Shunxiang A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title | A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title_full | A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title_fullStr | A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title_full_unstemmed | A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title_short | A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding |
title_sort | joint extraction model for entity relationships based on span and cascaded dual decoding |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453911/ https://www.ncbi.nlm.nih.gov/pubmed/37628247 http://dx.doi.org/10.3390/e25081217 |
work_keys_str_mv | AT liaotao ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding AT sunhaojie ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding AT zhangshunxiang ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding AT liaotao jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding AT sunhaojie jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding AT zhangshunxiang jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding |