Cargando…
Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction
Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two typ...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8575651/ https://www.ncbi.nlm.nih.gov/pubmed/34759966 http://dx.doi.org/10.1155/2021/6110885 |
_version_ | 1784595719143817216 |
---|---|
author | Yi, Qian Zhang, Guixuan Zhang, Shuwu |
author_facet | Yi, Qian Zhang, Guixuan Zhang, Shuwu |
author_sort | Yi, Qian |
collection | PubMed |
description | Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two types of noise and improve distantly supervised relation extraction, this paper proposes a novel distantly supervised relation extraction model, which consists of an entity-based gated convolution sentence encoder and a multilevel sentence selective attention (Matt) module. Specifically, we first apply an entity-based gated convolution operation to force the sentence encoder to extract entity-pair-related features and filter out useless intrasentence noise information. Furthermore, the multilevel attention schema fuses the bag information to obtain a fine-grained bag-specific query vector, which can better identify valid sentences and reduce the influence of wrongly labeled sentences. Experimental results on a large-scale benchmark dataset show that our model can effectively reduce the influence of the above two types of noise and achieves state-of-the-art performance in relation extraction. |
format | Online Article Text |
id | pubmed-8575651 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-85756512021-11-09 Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction Yi, Qian Zhang, Guixuan Zhang, Shuwu Comput Intell Neurosci Research Article Distant supervision is an effective method to automatically collect large-scale datasets for relation extraction (RE). Automatically constructed datasets usually comprise two types of noise: the intrasentence noise and the wrongly labeled noisy sentence. To address issues caused by the above two types of noise and improve distantly supervised relation extraction, this paper proposes a novel distantly supervised relation extraction model, which consists of an entity-based gated convolution sentence encoder and a multilevel sentence selective attention (Matt) module. Specifically, we first apply an entity-based gated convolution operation to force the sentence encoder to extract entity-pair-related features and filter out useless intrasentence noise information. Furthermore, the multilevel attention schema fuses the bag information to obtain a fine-grained bag-specific query vector, which can better identify valid sentences and reduce the influence of wrongly labeled sentences. Experimental results on a large-scale benchmark dataset show that our model can effectively reduce the influence of the above two types of noise and achieves state-of-the-art performance in relation extraction. Hindawi 2021-11-01 /pmc/articles/PMC8575651/ /pubmed/34759966 http://dx.doi.org/10.1155/2021/6110885 Text en Copyright © 2021 Qian Yi et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Yi, Qian Zhang, Guixuan Zhang, Shuwu Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title | Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title_full | Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title_fullStr | Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title_full_unstemmed | Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title_short | Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction |
title_sort | utilizing entity-based gated convolution and multilevel sentence attention to improve distantly supervised relation extraction |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8575651/ https://www.ncbi.nlm.nih.gov/pubmed/34759966 http://dx.doi.org/10.1155/2021/6110885 |
work_keys_str_mv | AT yiqian utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction AT zhangguixuan utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction AT zhangshuwu utilizingentitybasedgatedconvolutionandmultilevelsentenceattentiontoimprovedistantlysupervisedrelationextraction |