Cargando…

A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension

The machine comprehension research of clinical medicine has great potential value in practical application, but it has not received sufficient attention and many existing models are very time consuming for the cloze-style machine reading comprehension. In this paper, we study the cloze-style machine...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Bin, Zhang, Xuejie, Zhou, Xiaobing, Li, Junyi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7068278/
https://www.ncbi.nlm.nih.gov/pubmed/32092861
http://dx.doi.org/10.3390/ijerph17041323
_version_ 1783505542832979968
author Wang, Bin
Zhang, Xuejie
Zhou, Xiaobing
Li, Junyi
author_facet Wang, Bin
Zhang, Xuejie
Zhou, Xiaobing
Li, Junyi
author_sort Wang, Bin
collection PubMed
description The machine comprehension research of clinical medicine has great potential value in practical application, but it has not received sufficient attention and many existing models are very time consuming for the cloze-style machine reading comprehension. In this paper, we study the cloze-style machine reading comprehension in the clinical medical field and propose a Gated Dilated Convolution with Attention (GDCA) model, which consists of a gated dilated convolution module and an attention mechanism. Our model has high parallelism and is capable of capturing long-distance dependencies. On the CliCR data set, our model surpasses the present best model on several metrics and obtains state-of-the-art result, and the training speed is 8 times faster than that of the best model.
format Online
Article
Text
id pubmed-7068278
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-70682782020-03-19 A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension Wang, Bin Zhang, Xuejie Zhou, Xiaobing Li, Junyi Int J Environ Res Public Health Article The machine comprehension research of clinical medicine has great potential value in practical application, but it has not received sufficient attention and many existing models are very time consuming for the cloze-style machine reading comprehension. In this paper, we study the cloze-style machine reading comprehension in the clinical medical field and propose a Gated Dilated Convolution with Attention (GDCA) model, which consists of a gated dilated convolution module and an attention mechanism. Our model has high parallelism and is capable of capturing long-distance dependencies. On the CliCR data set, our model surpasses the present best model on several metrics and obtains state-of-the-art result, and the training speed is 8 times faster than that of the best model. MDPI 2020-02-19 2020-02 /pmc/articles/PMC7068278/ /pubmed/32092861 http://dx.doi.org/10.3390/ijerph17041323 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Bin
Zhang, Xuejie
Zhou, Xiaobing
Li, Junyi
A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title_full A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title_fullStr A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title_full_unstemmed A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title_short A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension
title_sort gated dilated convolution with attention model for clinical cloze-style reading comprehension
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7068278/
https://www.ncbi.nlm.nih.gov/pubmed/32092861
http://dx.doi.org/10.3390/ijerph17041323
work_keys_str_mv AT wangbin agateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT zhangxuejie agateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT zhouxiaobing agateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT lijunyi agateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT wangbin gateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT zhangxuejie gateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT zhouxiaobing gateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension
AT lijunyi gateddilatedconvolutionwithattentionmodelforclinicalclozestylereadingcomprehension