Cargando…
Event Recognition Based on Deep Learning in Chinese Texts
Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4976888/ https://www.ncbi.nlm.nih.gov/pubmed/27501231 http://dx.doi.org/10.1371/journal.pone.0160147 |
_version_ | 1782446931230851072 |
---|---|
author | Zhang, Yajun Liu, Zongtian Zhou, Wen |
author_facet | Zhang, Yajun Liu, Zongtian Zhou, Wen |
author_sort | Zhang, Yajun |
collection | PubMed |
description | Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods based on shallow neural networks converge too quickly to a local minimum, resulting in low recognition precision. To address these problems, we propose the Chinese emergency event recognition model based on deep learning (CEERM). Firstly, we use a word segmentation system to segment sentences. According to event elements labeled in the CEC 2.0 corpus, we classify words into five categories: trigger words, participants, objects, time and location. Each word is vectorized according to the following six feature layers: part of speech, dependency grammar, length, location, distance between trigger word and core word and trigger word frequency. We obtain deep semantic features of words by training a feature vector set using a deep belief network (DBN), then analyze those features in order to identify trigger words by means of a back propagation neural network. Extensive testing shows that the CEERM achieves excellent recognition performance, with a maximum F-measure value of 85.17%. Moreover, we propose the dynamic-supervised DBN, which adds supervised fine-tuning to a restricted Boltzmann machine layer by monitoring its training performance. Test analysis reveals that the new DBN improves recognition performance and effectively controls the training time. Although the F-measure increases to 88.11%, the training time increases by only 25.35%. |
format | Online Article Text |
id | pubmed-4976888 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-49768882016-08-25 Event Recognition Based on Deep Learning in Chinese Texts Zhang, Yajun Liu, Zongtian Zhou, Wen PLoS One Research Article Event recognition is the most fundamental and critical task in event-based natural language processing systems. Existing event recognition methods based on rules and shallow neural networks have certain limitations. For example, extracting features using methods based on rules is difficult; methods based on shallow neural networks converge too quickly to a local minimum, resulting in low recognition precision. To address these problems, we propose the Chinese emergency event recognition model based on deep learning (CEERM). Firstly, we use a word segmentation system to segment sentences. According to event elements labeled in the CEC 2.0 corpus, we classify words into five categories: trigger words, participants, objects, time and location. Each word is vectorized according to the following six feature layers: part of speech, dependency grammar, length, location, distance between trigger word and core word and trigger word frequency. We obtain deep semantic features of words by training a feature vector set using a deep belief network (DBN), then analyze those features in order to identify trigger words by means of a back propagation neural network. Extensive testing shows that the CEERM achieves excellent recognition performance, with a maximum F-measure value of 85.17%. Moreover, we propose the dynamic-supervised DBN, which adds supervised fine-tuning to a restricted Boltzmann machine layer by monitoring its training performance. Test analysis reveals that the new DBN improves recognition performance and effectively controls the training time. Although the F-measure increases to 88.11%, the training time increases by only 25.35%. Public Library of Science 2016-08-08 /pmc/articles/PMC4976888/ /pubmed/27501231 http://dx.doi.org/10.1371/journal.pone.0160147 Text en © 2016 Zhang et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Zhang, Yajun Liu, Zongtian Zhou, Wen Event Recognition Based on Deep Learning in Chinese Texts |
title | Event Recognition Based on Deep Learning in Chinese Texts |
title_full | Event Recognition Based on Deep Learning in Chinese Texts |
title_fullStr | Event Recognition Based on Deep Learning in Chinese Texts |
title_full_unstemmed | Event Recognition Based on Deep Learning in Chinese Texts |
title_short | Event Recognition Based on Deep Learning in Chinese Texts |
title_sort | event recognition based on deep learning in chinese texts |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4976888/ https://www.ncbi.nlm.nih.gov/pubmed/27501231 http://dx.doi.org/10.1371/journal.pone.0160147 |
work_keys_str_mv | AT zhangyajun eventrecognitionbasedondeeplearninginchinesetexts AT liuzongtian eventrecognitionbasedondeeplearninginchinesetexts AT zhouwen eventrecognitionbasedondeeplearninginchinesetexts AT eventrecognitionbasedondeeplearninginchinesetexts |