Cargando…

A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding

The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship...

Descripción completa

Detalles Bibliográficos
Autores principales: Liao, Tao, Sun, Haojie, Zhang, Shunxiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453911/
https://www.ncbi.nlm.nih.gov/pubmed/37628247
http://dx.doi.org/10.3390/e25081217
_version_ 1785096060124790784
author Liao, Tao
Sun, Haojie
Zhang, Shunxiang
author_facet Liao, Tao
Sun, Haojie
Zhang, Shunxiang
author_sort Liao, Tao
collection PubMed
description The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship extraction model based on the span and a cascaded dual decoding. The model includes a Bidirectional Encoder Representations from Transformers (BERT) encoding layer, a relational decoding layer, and an entity decoding layer. The model first converts the text input into the BERT pretrained language model into word vectors. Then, it divides the word vectors based on the span to form a span sequence and decodes the relationship between the span sequence to obtain the relationship type in the span sequence. Finally, the entity decoding layer fuses the span sequences and the relationship type obtained by relation decoding and uses a bi-directional long short-term memory (Bi-LSTM) neural network to obtain the head entity and tail entity in the span sequence. Using the combination of span division and cascaded double decoding, the overlapping relations existing in the text can be effectively identified. Experiments show that compared with other baseline models, the F1 value of the model is effectively improved on the NYT dataset and WebNLG dataset.
format Online
Article
Text
id pubmed-10453911
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104539112023-08-26 A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding Liao, Tao Sun, Haojie Zhang, Shunxiang Entropy (Basel) Article The entity–relationship joint extraction model plays a significant role in entity relationship extraction. The existing entity–relationship joint extraction model cannot effectively identify entity–relationship triples in overlapping relationships. This paper proposes a new joint entity–relationship extraction model based on the span and a cascaded dual decoding. The model includes a Bidirectional Encoder Representations from Transformers (BERT) encoding layer, a relational decoding layer, and an entity decoding layer. The model first converts the text input into the BERT pretrained language model into word vectors. Then, it divides the word vectors based on the span to form a span sequence and decodes the relationship between the span sequence to obtain the relationship type in the span sequence. Finally, the entity decoding layer fuses the span sequences and the relationship type obtained by relation decoding and uses a bi-directional long short-term memory (Bi-LSTM) neural network to obtain the head entity and tail entity in the span sequence. Using the combination of span division and cascaded double decoding, the overlapping relations existing in the text can be effectively identified. Experiments show that compared with other baseline models, the F1 value of the model is effectively improved on the NYT dataset and WebNLG dataset. MDPI 2023-08-16 /pmc/articles/PMC10453911/ /pubmed/37628247 http://dx.doi.org/10.3390/e25081217 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liao, Tao
Sun, Haojie
Zhang, Shunxiang
A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title_full A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title_fullStr A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title_full_unstemmed A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title_short A Joint Extraction Model for Entity Relationships Based on Span and Cascaded Dual Decoding
title_sort joint extraction model for entity relationships based on span and cascaded dual decoding
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453911/
https://www.ncbi.nlm.nih.gov/pubmed/37628247
http://dx.doi.org/10.3390/e25081217
work_keys_str_mv AT liaotao ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding
AT sunhaojie ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding
AT zhangshunxiang ajointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding
AT liaotao jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding
AT sunhaojie jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding
AT zhangshunxiang jointextractionmodelforentityrelationshipsbasedonspanandcascadeddualdecoding