Cargando…
Span-based single-stage joint entity-relation extraction model
Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in exist...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9904475/ https://www.ncbi.nlm.nih.gov/pubmed/36749758 http://dx.doi.org/10.1371/journal.pone.0281055 |
_version_ | 1784883621890359296 |
---|---|
author | Han, Dongchen Zheng, Zhaoqian Zhao, Hui Feng, Shanshan Pang, Haiting |
author_facet | Han, Dongchen Zheng, Zhaoqian Zhao, Hui Feng, Shanshan Pang, Haiting |
author_sort | Han, Dongchen |
collection | PubMed |
description | Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in existing entity relation extraction approaches, we propose a joint entity relation extraction model (SMHS) based on a span-level multi-head selection mechanism, transforming entity relation extraction into a span-level multi-head selection problem. Our model uses span-tagger and span-embedding to construct span semantic vectors, utilizes LSTM and multi-head self-attention mechanism for span feature extraction, multi-head selection mechanism for span-level relation decoding, and introduces span classification task for multi-task learning to decode out the relation triad in a single-stage. Experiments on the classic English dataset NYT and the publicly available Chinese relationship extraction dataset DuIE 2.0 show that this method achieves better results than the baseline method, which verifies the effectiveness of this method. Source code and data are published here(https://github.com/Beno-waxgourd/NLP.git). |
format | Online Article Text |
id | pubmed-9904475 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-99044752023-02-08 Span-based single-stage joint entity-relation extraction model Han, Dongchen Zheng, Zhaoqian Zhao, Hui Feng, Shanshan Pang, Haiting PLoS One Research Article Extracting entities and relations from the unstructured text has attracted increasing attention in recent years. The existing work has achieved considerable results, yet it is difficult to solve entity overlap and exposure bias. To address cascading errors, exposure bias, and entity overlap in existing entity relation extraction approaches, we propose a joint entity relation extraction model (SMHS) based on a span-level multi-head selection mechanism, transforming entity relation extraction into a span-level multi-head selection problem. Our model uses span-tagger and span-embedding to construct span semantic vectors, utilizes LSTM and multi-head self-attention mechanism for span feature extraction, multi-head selection mechanism for span-level relation decoding, and introduces span classification task for multi-task learning to decode out the relation triad in a single-stage. Experiments on the classic English dataset NYT and the publicly available Chinese relationship extraction dataset DuIE 2.0 show that this method achieves better results than the baseline method, which verifies the effectiveness of this method. Source code and data are published here(https://github.com/Beno-waxgourd/NLP.git). Public Library of Science 2023-02-07 /pmc/articles/PMC9904475/ /pubmed/36749758 http://dx.doi.org/10.1371/journal.pone.0281055 Text en © 2023 Han et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Han, Dongchen Zheng, Zhaoqian Zhao, Hui Feng, Shanshan Pang, Haiting Span-based single-stage joint entity-relation extraction model |
title | Span-based single-stage joint entity-relation extraction model |
title_full | Span-based single-stage joint entity-relation extraction model |
title_fullStr | Span-based single-stage joint entity-relation extraction model |
title_full_unstemmed | Span-based single-stage joint entity-relation extraction model |
title_short | Span-based single-stage joint entity-relation extraction model |
title_sort | span-based single-stage joint entity-relation extraction model |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9904475/ https://www.ncbi.nlm.nih.gov/pubmed/36749758 http://dx.doi.org/10.1371/journal.pone.0281055 |
work_keys_str_mv | AT handongchen spanbasedsinglestagejointentityrelationextractionmodel AT zhengzhaoqian spanbasedsinglestagejointentityrelationextractionmodel AT zhaohui spanbasedsinglestagejointentityrelationextractionmodel AT fengshanshan spanbasedsinglestagejointentityrelationextractionmodel AT panghaiting spanbasedsinglestagejointentityrelationextractionmodel |