Cargando…

Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network

The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sent...

Descripción completa

Detalles Bibliográficos
Autores principales: Zheng, Wenfeng, Yin, Lirong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9044352/
https://www.ncbi.nlm.nih.gov/pubmed/35494798
http://dx.doi.org/10.7717/peerj-cs.908
_version_ 1784695087278587904
author Zheng, Wenfeng
Yin, Lirong
author_facet Zheng, Wenfeng
Yin, Lirong
author_sort Zheng, Wenfeng
collection PubMed
description The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sentence representation module or a reasoning model. It proposes a joint optimization method based on multi-layer semantics called the Semantic Fusion Deep Matching Network (SCF-DMN) to explore the influence of sentence representation and reasoning models on reasoning performance. Experiments on text entailment recognition tasks show that the joint optimization representation reasoning method performs better than the existing methods. The sentence representation optimization module and the improved optimization reasoning model can promote reasoning performance when used individually. However, the optimization of the reasoning model has a more significant impact on the final reasoning results. Furthermore, after comparing each module’s performance, there is a mutual constraint between the sentence representation module and the reasoning model. This condition restricts overall performance, resulting in no linear superposition of reasoning performance. Overall, by comparing the proposed methods with other existed methods that are tested using the same database, the proposed method solves the lack of in-depth interactive information and interpretability in the model design which would be inspirational for future improving and studying of natural language reasoning.
format Online
Article
Text
id pubmed-9044352
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-90443522022-04-28 Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network Zheng, Wenfeng Yin, Lirong PeerJ Comput Sci Artificial Intelligence The whole sentence representation reasoning process simultaneously comprises a sentence representation module and a semantic reasoning module. This paper combines the multi-layer semantic representation network with the deep fusion matching network to solve the limitations of only considering a sentence representation module or a reasoning model. It proposes a joint optimization method based on multi-layer semantics called the Semantic Fusion Deep Matching Network (SCF-DMN) to explore the influence of sentence representation and reasoning models on reasoning performance. Experiments on text entailment recognition tasks show that the joint optimization representation reasoning method performs better than the existing methods. The sentence representation optimization module and the improved optimization reasoning model can promote reasoning performance when used individually. However, the optimization of the reasoning model has a more significant impact on the final reasoning results. Furthermore, after comparing each module’s performance, there is a mutual constraint between the sentence representation module and the reasoning model. This condition restricts overall performance, resulting in no linear superposition of reasoning performance. Overall, by comparing the proposed methods with other existed methods that are tested using the same database, the proposed method solves the lack of in-depth interactive information and interpretability in the model design which would be inspirational for future improving and studying of natural language reasoning. PeerJ Inc. 2022-04-12 /pmc/articles/PMC9044352/ /pubmed/35494798 http://dx.doi.org/10.7717/peerj-cs.908 Text en © 2022 Zheng and Yin https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Artificial Intelligence
Zheng, Wenfeng
Yin, Lirong
Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title_full Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title_fullStr Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title_full_unstemmed Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title_short Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
title_sort characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
topic Artificial Intelligence
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9044352/
https://www.ncbi.nlm.nih.gov/pubmed/35494798
http://dx.doi.org/10.7717/peerj-cs.908
work_keys_str_mv AT zhengwenfeng characterizationinferencebasedonjointoptimizationofmultilayersemanticsanddeepfusionmatchingnetwork
AT yinlirong characterizationinferencebasedonjointoptimizationofmultilayersemanticsanddeepfusionmatchingnetwork