Cargando…

Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism

Commonly used nested entity recognition methods are span-based entity recognition methods, which focus on learning the head and tail representations of entities. This method lacks obvious boundary supervision, which leads to the failure of the correct candidate entities to be predicted, resulting in...

Descripción completa

Detalles Bibliográficos
Autores principales: Gao, Wenchao, Li, Yu, Guan, Xiaole, Chen, Shiyu, Zhao, Shanshan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9436550/
https://www.ncbi.nlm.nih.gov/pubmed/36059424
http://dx.doi.org/10.1155/2022/2687615
_version_ 1784781391252160512
author Gao, Wenchao
Li, Yu
Guan, Xiaole
Chen, Shiyu
Zhao, Shanshan
author_facet Gao, Wenchao
Li, Yu
Guan, Xiaole
Chen, Shiyu
Zhao, Shanshan
author_sort Gao, Wenchao
collection PubMed
description Commonly used nested entity recognition methods are span-based entity recognition methods, which focus on learning the head and tail representations of entities. This method lacks obvious boundary supervision, which leads to the failure of the correct candidate entities to be predicted, resulting in the problem of high precision and low recall. To solve the above problems, this paper proposes a named entity recognition method based on multi-task learning and biaffine mechanism, introduces the idea of multi-task learning, and divides the task into two subtasks, entity span classification and boundary detection. The entity span classification task uses biaffine mechanism to score the resulting spans and select the most likely entity class. The boundary detection task mainly solves the problem of low recall caused by the lack of boundary supervision in span classification. It captures the relationship between adjacent words in the input text according to the context, indicates the boundary range of entities, and enhances the span representation through additional boundary supervision. The experimental results show that the named entity recognition method based on multi-task learning and biaffine mechanism can improve the F1 value by up to 7.05%, 12.63%, and 14.68% on the GENIA, ACE2004, and ACE2005 nested datasets compared with other methods, which verifies that this method has better performance on the nested entity recognition task.
format Online
Article
Text
id pubmed-9436550
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-94365502022-09-02 Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism Gao, Wenchao Li, Yu Guan, Xiaole Chen, Shiyu Zhao, Shanshan Comput Intell Neurosci Research Article Commonly used nested entity recognition methods are span-based entity recognition methods, which focus on learning the head and tail representations of entities. This method lacks obvious boundary supervision, which leads to the failure of the correct candidate entities to be predicted, resulting in the problem of high precision and low recall. To solve the above problems, this paper proposes a named entity recognition method based on multi-task learning and biaffine mechanism, introduces the idea of multi-task learning, and divides the task into two subtasks, entity span classification and boundary detection. The entity span classification task uses biaffine mechanism to score the resulting spans and select the most likely entity class. The boundary detection task mainly solves the problem of low recall caused by the lack of boundary supervision in span classification. It captures the relationship between adjacent words in the input text according to the context, indicates the boundary range of entities, and enhances the span representation through additional boundary supervision. The experimental results show that the named entity recognition method based on multi-task learning and biaffine mechanism can improve the F1 value by up to 7.05%, 12.63%, and 14.68% on the GENIA, ACE2004, and ACE2005 nested datasets compared with other methods, which verifies that this method has better performance on the nested entity recognition task. Hindawi 2022-08-25 /pmc/articles/PMC9436550/ /pubmed/36059424 http://dx.doi.org/10.1155/2022/2687615 Text en Copyright © 2022 Wenchao Gao et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Gao, Wenchao
Li, Yu
Guan, Xiaole
Chen, Shiyu
Zhao, Shanshan
Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title_full Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title_fullStr Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title_full_unstemmed Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title_short Research on Named Entity Recognition Based on Multi-Task Learning and Biaffine Mechanism
title_sort research on named entity recognition based on multi-task learning and biaffine mechanism
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9436550/
https://www.ncbi.nlm.nih.gov/pubmed/36059424
http://dx.doi.org/10.1155/2022/2687615
work_keys_str_mv AT gaowenchao researchonnamedentityrecognitionbasedonmultitasklearningandbiaffinemechanism
AT liyu researchonnamedentityrecognitionbasedonmultitasklearningandbiaffinemechanism
AT guanxiaole researchonnamedentityrecognitionbasedonmultitasklearningandbiaffinemechanism
AT chenshiyu researchonnamedentityrecognitionbasedonmultitasklearningandbiaffinemechanism
AT zhaoshanshan researchonnamedentityrecognitionbasedonmultitasklearningandbiaffinemechanism