Cargando…

Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction

Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two typ...

Descripción completa

Detalles Bibliográficos
Autores principales: Yi, Qian, Zhang, Guixuan, Zhang, Shuwu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8575651/
https://www.ncbi.nlm.nih.gov/pubmed/34759966
http://dx.doi.org/10.1155/2021/6110885
_version_ 1784595719143817216
author Yi, Qian
Zhang, Guixuan
Zhang, Shuwu
author_facet Yi, Qian
Zhang, Guixuan
Zhang, Shuwu
author_sort Yi, Qian
collection PubMed
description Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two types of noise and improve distantly supervised relation extraction, this paper proposes a novel distantly supervised relation extraction model, which consists of an entity-based gated convolution sentence encoder and a multilevel sentence selective attention (Matt) module. Specifically, we first apply an entity-based gated convolution operation to force the sentence encoder to extract entity-pair-related features and filter out useless intrasentence noise information. Furthermore, the multilevel attention schema fuses the bag information to obtain a fine-grained bag-specific query vector, which can better identify valid sentences and reduce the influence of wrongly labeled sentences. Experimental results on a large-scale benchmark dataset show that our model can effectively reduce the influence of the above two types of noise and achieves state-of-the-art performance in relation extraction.
format Online
Article
Text
id pubmed-8575651
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-85756512021-11-09 Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction Yi, Qian Zhang, Guixuan Zhang, Shuwu Comput Intell Neurosci Research Article Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two types of noise and improve distantly supervised relation extraction, this paper proposes a novel distantly supervised relation extraction model, which consists of an entity-based gated convolution sentence encoder and a multilevel sentence selective attention (Matt) module. Specifically, we first apply an entity-based gated convolution operation to force the sentence encoder to extract entity-pair-related features and filter out useless intrasentence noise information. Furthermore, the multilevel attention schema fuses the bag information to obtain a fine-grained bag-specific query vector, which can better identify valid sentences and reduce the influence of wrongly labeled sentences. Experimental results on a large-scale benchmark dataset show that our model can effectively reduce the influence of the above two types of noise and achieves state-of-the-art performance in relation extraction. Hindawi 2021-11-01 /pmc/articles/PMC8575651/ /pubmed/34759966 http://dx.doi.org/10.1155/2021/6110885 Text en Copyright © 2021 Qian Yi et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Yi, Qian
Zhang, Guixuan
Zhang, Shuwu
Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title_full Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title_fullStr Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title_full_unstemmed Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title_short Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
title_sort utilizing entity-based gated convolution and multilevel sentence attention to improve distantly supervised relation extraction
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8575651/
https://www.ncbi.nlm.nih.gov/pubmed/34759966
http://dx.doi.org/10.1155/2021/6110885
work_keys_str_mv AT yiqian utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction
AT zhangguixuan utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction
AT zhangshuwu utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction