Cargando…

Span-based single-stage joint entity-relation extraction model

Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in exist...

Descripción completa

Detalles Bibliográficos
Autores principales: Han, Dongchen, Zheng, Zhaoqian, Zhao, Hui, Feng, Shanshan, Pang, Haiting
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9904475/
https://www.ncbi.nlm.nih.gov/pubmed/36749758
http://dx.doi.org/10.1371/journal.pone.0281055
_version_ 1784883621890359296
author Han, Dongchen
Zheng, Zhaoqian
Zhao, Hui
Feng, Shanshan
Pang, Haiting
author_facet Han, Dongchen
Zheng, Zhaoqian
Zhao, Hui
Feng, Shanshan
Pang, Haiting
author_sort Han, Dongchen
collection PubMed
description Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in existing entity relation extraction approaches, we propose a joint entity relation extraction model (SMHS) based on a span-level multi-head selection mechanism, transforming entity relation extraction into a span-level multi-head selection problem. Our model uses span-tagger and span-embedding to construct span semantic vectors, utilizes LSTM and multi-head self-attention mechanism for span feature extraction, multi-head selection mechanism for span-level relation decoding, and introduces span classification task for multi-task learning to decode out the relation triad in a single-stage. Experiments on the classic English dataset NYT and the publicly available Chinese relationship extraction dataset DuIE 2.0 show that this method achieves better results than the baseline method, which verifies the effectiveness of this method. Source code and data are published here(https://github.com/Beno-waxgourd/NLP.git).
format Online
Article
Text
id pubmed-9904475
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-99044752023-02-08 Span-based single-stage joint entity-relation extraction model Han, Dongchen Zheng, Zhaoqian Zhao, Hui Feng, Shanshan Pang, Haiting PLoS One Research Article Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in existing entity relation extraction approaches, we propose a joint entity relation extraction model (SMHS) based on a span-level multi-head selection mechanism, transforming entity relation extraction into a span-level multi-head selection problem. Our model uses span-tagger and span-embedding to construct span semantic vectors, utilizes LSTM and multi-head self-attention mechanism for span feature extraction, multi-head selection mechanism for span-level relation decoding, and introduces span classification task for multi-task learning to decode out the relation triad in a single-stage. Experiments on the classic English dataset NYT and the publicly available Chinese relationship extraction dataset DuIE 2.0 show that this method achieves better results than the baseline method, which verifies the effectiveness of this method. Source code and data are published here(https://github.com/Beno-waxgourd/NLP.git). Public Library of Science 2023-02-07 /pmc/articles/PMC9904475/ /pubmed/36749758 http://dx.doi.org/10.1371/journal.pone.0281055 Text en © 2023 Han et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Han, Dongchen
Zheng, Zhaoqian
Zhao, Hui
Feng, Shanshan
Pang, Haiting
Span-based single-stage joint entity-relation extraction model
title Span-based single-stage joint entity-relation extraction model
title_full Span-based single-stage joint entity-relation extraction model
title_fullStr Span-based single-stage joint entity-relation extraction model
title_full_unstemmed Span-based single-stage joint entity-relation extraction model
title_short Span-based single-stage joint entity-relation extraction model
title_sort span-based single-stage joint entity-relation extraction model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9904475/
https://www.ncbi.nlm.nih.gov/pubmed/36749758
http://dx.doi.org/10.1371/journal.pone.0281055
work_keys_str_mv AT handongchen spanbasedsinglestagejointentityrelationextractionmodel
AT zhengzhaoqian spanbasedsinglestagejointentityrelationextractionmodel
AT zhaohui spanbasedsinglestagejointentityrelationextractionmodel
AT fengshanshan spanbasedsinglestagejointentityrelationextractionmodel
AT panghaiting spanbasedsinglestagejointentityrelationextractionmodel