Cargando…
CNN-based framework for classifying temporal relations with question encoder
Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well d...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513567/ https://www.ncbi.nlm.nih.gov/pubmed/34776775 http://dx.doi.org/10.1007/s00799-021-00310-1 |
_version_ | 1784583234252701696 |
---|---|
author | Seki, Yohei Zhao, Kangkang Oguni, Masaki Sugiyama, Kazunari |
author_facet | Seki, Yohei Zhao, Kangkang Oguni, Masaki Sugiyama, Kazunari |
author_sort | Seki, Yohei |
collection | PubMed |
description | Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well due to the lack of task-related information. To overcome this problem, we propose a novel framework that incorporates prior information by employing awareness of events and time expressions (time–event entities) with various window sizes to focus on context words around the entities as a filter. We refer to this module as “question encoder.” In our approach, this kind of prior information can extract task-related information from simple sentence embedding. Our experimental results on a publicly available Timebank-Dense corpus demonstrate that our approach outperforms some state-of-the-art techniques, including CNN-, LSTM-, and BERT-based temporal relation classifiers. |
format | Online Article Text |
id | pubmed-8513567 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-85135672021-10-13 CNN-based framework for classifying temporal relations with question encoder Seki, Yohei Zhao, Kangkang Oguni, Masaki Sugiyama, Kazunari Int J Digit Libr Article Temporal-relation classification plays an important role in the field of natural language processing. Various deep learning-based classifiers, which can generate better models using sentence embedding, have been proposed to address this challenging task. These approaches, however, do not work well due to the lack of task-related information. To overcome this problem, we propose a novel framework that incorporates prior information by employing awareness of events and time expressions (time–event entities) with various window sizes to focus on context words around the entities as a filter. We refer to this module as “question encoder.” In our approach, this kind of prior information can extract task-related information from simple sentence embedding. Our experimental results on a publicly available Timebank-Dense corpus demonstrate that our approach outperforms some state-of-the-art techniques, including CNN-, LSTM-, and BERT-based temporal relation classifiers. Springer Berlin Heidelberg 2021-10-13 2022 /pmc/articles/PMC8513567/ /pubmed/34776775 http://dx.doi.org/10.1007/s00799-021-00310-1 Text en © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Seki, Yohei Zhao, Kangkang Oguni, Masaki Sugiyama, Kazunari CNN-based framework for classifying temporal relations with question encoder |
title | CNN-based framework for classifying temporal relations with question encoder |
title_full | CNN-based framework for classifying temporal relations with question encoder |
title_fullStr | CNN-based framework for classifying temporal relations with question encoder |
title_full_unstemmed | CNN-based framework for classifying temporal relations with question encoder |
title_short | CNN-based framework for classifying temporal relations with question encoder |
title_sort | cnn-based framework for classifying temporal relations with question encoder |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8513567/ https://www.ncbi.nlm.nih.gov/pubmed/34776775 http://dx.doi.org/10.1007/s00799-021-00310-1 |
work_keys_str_mv | AT sekiyohei cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder AT zhaokangkang cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder AT ogunimasaki cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder AT sugiyamakazunari cnnbasedframeworkforclassifyingtemporalrelationswithquestionencoder |