Cargando…

Event Recognition Based on Deep Learning in Chinese Texts

Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Yajun, Liu, Zongtian, Zhou, Wen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4976888/
https://www.ncbi.nlm.nih.gov/pubmed/27501231
http://dx.doi.org/10.1371/journal.pone.0160147
_version_ 1782446931230851072
author Zhang, Yajun
Liu, Zongtian
Zhou, Wen
author_facet Zhang, Yajun
Liu, Zongtian
Zhou, Wen
author_sort Zhang, Yajun
collection PubMed
description Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods based on shallow neural networks converge too quickly to a local minimum, resulting in low recognition precision. To address these problems, we propose the Chinese emergency event recognition model based on deep learning (CEERM). Firstly, we use a word segmentation system to segment sentences. According to event elements labeled in the CEC 2.0 corpus, we classify words into five categories: trigger words, participants, objects, time and location. Each word is vectorized according to the following six feature layers: part of speech, dependency grammar, length, location, distance between trigger word and core word and trigger word frequency. We obtain deep semantic features of words by training a feature vector set using a deep belief network (DBN), then analyze those features in order to identify trigger words by means of a back propagation neural network. Extensive testing shows that the CEERM achieves excellent recognition performance, with a maximum F-measure value of 85.17%. Moreover, we propose the dynamic-supervised DBN, which adds supervised fine-tuning to a restricted Boltzmann machine layer by monitoring its training performance. Test analysis reveals that the new DBN improves recognition performance and effectively controls the training time. Although the F-measure increases to 88.11%, the training time increases by only 25.35%.
format Online
Article
Text
id pubmed-4976888
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-49768882016-08-25 Event Recognition Based on Deep Learning in Chinese Texts Zhang, Yajun Liu, Zongtian Zhou, Wen PLoS One Research Article Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods based on shallow neural networks converge too quickly to a local minimum, resulting in low recognition precision. To address these problems, we propose the Chinese emergency event recognition model based on deep learning (CEERM). Firstly, we use a word segmentation system to segment sentences. According to event elements labeled in the CEC 2.0 corpus, we classify words into five categories: trigger words, participants, objects, time and location. Each word is vectorized according to the following six feature layers: part of speech, dependency grammar, length, location, distance between trigger word and core word and trigger word frequency. We obtain deep semantic features of words by training a feature vector set using a deep belief network (DBN), then analyze those features in order to identify trigger words by means of a back propagation neural network. Extensive testing shows that the CEERM achieves excellent recognition performance, with a maximum F-measure value of 85.17%. Moreover, we propose the dynamic-supervised DBN, which adds supervised fine-tuning to a restricted Boltzmann machine layer by monitoring its training performance. Test analysis reveals that the new DBN improves recognition performance and effectively controls the training time. Although the F-measure increases to 88.11%, the training time increases by only 25.35%. Public Library of Science 2016-08-08 /pmc/articles/PMC4976888/ /pubmed/27501231 http://dx.doi.org/10.1371/journal.pone.0160147 Text en © 2016 Zhang et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Zhang, Yajun
Liu, Zongtian
Zhou, Wen
Event Recognition Based on Deep Learning in Chinese Texts
title Event Recognition Based on Deep Learning in Chinese Texts
title_full Event Recognition Based on Deep Learning in Chinese Texts
title_fullStr Event Recognition Based on Deep Learning in Chinese Texts
title_full_unstemmed Event Recognition Based on Deep Learning in Chinese Texts
title_short Event Recognition Based on Deep Learning in Chinese Texts
title_sort event recognition based on deep learning in chinese texts
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4976888/
https://www.ncbi.nlm.nih.gov/pubmed/27501231
http://dx.doi.org/10.1371/journal.pone.0160147
work_keys_str_mv AT zhangyajun eventrecognitionbasedondeeplearninginchinesetexts
AT liuzongtian eventrecognitionbasedondeeplearninginchinesetexts
AT zhouwen eventrecognitionbasedondeeplearninginchinesetexts
AT eventrecognitionbasedondeeplearninginchinesetexts