Cargando…
Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sent...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9044352/ https://www.ncbi.nlm.nih.gov/pubmed/35494798 http://dx.doi.org/10.7717/peerj-cs.908 |
_version_ | 1784695087278587904 |
---|---|
author | Zheng, Wenfeng Yin, Lirong |
author_facet | Zheng, Wenfeng Yin, Lirong |
author_sort | Zheng, Wenfeng |
collection | PubMed |
description | The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sentence representation module or a reasoning model. It proposes a joint optimization method based on multi-layer semantics called the Semantic Fusion Deep Matching Network (SCF-DMN) to explore the influence of sentence representation and reasoning models on reasoning performance. Experiments on text entailment recognition tasks show that the joint optimization representation reasoning method performs better than the existing methods. The sentence representation optimization module and the improved optimization reasoning model can promote reasoning performance when used individually. However, the optimization of the reasoning model has a more significant impact on the final reasoning results. Furthermore, after comparing each module’s performance, there is a mutual constraint between the sentence representation module and the reasoning model. This condition restricts overall performance, resulting in no linear superposition of reasoning performance. Overall, by comparing the proposed methods with other existed methods that are tested using the same database, the proposed method solves the lack of in-depth interactive information and interpretability in the model design which would be inspirational for future improving and studying of natural language reasoning. |
format | Online Article Text |
id | pubmed-9044352 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90443522022-04-28 Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network Zheng, Wenfeng Yin, Lirong PeerJ Comput Sci Artificial Intelligence The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sentence representation module or a reasoning model. It proposes a joint optimization method based on multi-layer semantics called the Semantic Fusion Deep Matching Network (SCF-DMN) to explore the influence of sentence representation and reasoning models on reasoning performance. Experiments on text entailment recognition tasks show that the joint optimization representation reasoning method performs better than the existing methods. The sentence representation optimization module and the improved optimization reasoning model can promote reasoning performance when used individually. However, the optimization of the reasoning model has a more significant impact on the final reasoning results. Furthermore, after comparing each module’s performance, there is a mutual constraint between the sentence representation module and the reasoning model. This condition restricts overall performance, resulting in no linear superposition of reasoning performance. Overall, by comparing the proposed methods with other existed methods that are tested using the same database, the proposed method solves the lack of in-depth interactive information and interpretability in the model design which would be inspirational for future improving and studying of natural language reasoning. PeerJ Inc. 2022-04-12 /pmc/articles/PMC9044352/ /pubmed/35494798 http://dx.doi.org/10.7717/peerj-cs.908 Text en © 2022 Zheng and Yin https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited. |
spellingShingle | Artificial Intelligence Zheng, Wenfeng Yin, Lirong Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title | Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title_full | Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title_fullStr | Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title_full_unstemmed | Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title_short | Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
title_sort | characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network |
topic | Artificial Intelligence |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9044352/ https://www.ncbi.nlm.nih.gov/pubmed/35494798 http://dx.doi.org/10.7717/peerj-cs.908 |
work_keys_str_mv | AT zhengwenfeng characterizationinferencebasedonjointoptimizationofmultilayersemanticsanddeepfusionmatchingnetwork AT yinlirong characterizationinferencebasedonjointoptimizationofmultilayersemanticsanddeepfusionmatchingnetwork |