Cargando…

CNN-based framework for classifying temporal relations with question encoder

Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well d...

Descripción completa

Detalles Bibliográficos
Autores principales: Seki, Yohei, Zhao, Kangkang, Oguni, Masaki, Sugiyama, Kazunari
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513567/
https://www.ncbi.nlm.nih.gov/pubmed/34776775
http://dx.doi.org/10.1007/s00799-021-00310-1
_version_ 1784583234252701696
author Seki, Yohei
Zhao, Kangkang
Oguni, Masaki
Sugiyama, Kazunari
author_facet Seki, Yohei
Zhao, Kangkang
Oguni, Masaki
Sugiyama, Kazunari
author_sort Seki, Yohei
collection PubMed
description Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well due to the lack of task-related information. To overcome this problem, we propose a novel framework that incorporates prior information by employing awareness of events and time expressions (time–event entities) with various window sizes to focus on context words around the entities as a filter. We refer to this module as “question encoder.” In our approach, this kind of prior information can extract task-related information from simple sentence embedding. Our experimental results on a publicly available Timebank-Dense corpus demonstrate that our approach outperforms some state-of-the-art techniques, including CNN-, LSTM-, and BERT-based temporal relation classifiers.
format Online
Article
Text
id pubmed-8513567
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-85135672021-10-13 CNN-based framework for classifying temporal relations with question encoder Seki, Yohei Zhao, Kangkang Oguni, Masaki Sugiyama, Kazunari Int J Digit Libr Article Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well due to the lack of task-related information. To overcome this problem, we propose a novel framework that incorporates prior information by employing awareness of events and time expressions (time–event entities) with various window sizes to focus on context words around the entities as a filter. We refer to this module as “question encoder.” In our approach, this kind of prior information can extract task-related information from simple sentence embedding. Our experimental results on a publicly available Timebank-Dense corpus demonstrate that our approach outperforms some state-of-the-art techniques, including CNN-, LSTM-, and BERT-based temporal relation classifiers. Springer Berlin Heidelberg 2021-10-13 2022 /pmc/articles/PMC8513567/ /pubmed/34776775 http://dx.doi.org/10.1007/s00799-021-00310-1 Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Seki, Yohei
Zhao, Kangkang
Oguni, Masaki
Sugiyama, Kazunari
CNN-based framework for classifying temporal relations with question encoder
title CNN-based framework for classifying temporal relations with question encoder
title_full CNN-based framework for classifying temporal relations with question encoder
title_fullStr CNN-based framework for classifying temporal relations with question encoder
title_full_unstemmed CNN-based framework for classifying temporal relations with question encoder
title_short CNN-based framework for classifying temporal relations with question encoder
title_sort cnn-based framework for classifying temporal relations with question encoder
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513567/
https://www.ncbi.nlm.nih.gov/pubmed/34776775
http://dx.doi.org/10.1007/s00799-021-00310-1
work_keys_str_mv AT sekiyohei cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder
AT zhaokangkang cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder
AT ogunimasaki cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder
AT sugiyamakazunari cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder