Cargando…

Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding

Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Re...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Lei, Sun, Yeguo, Liu, Yihong, Roxas, Rachel Edita O., Raga, Rodolfo C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9482477/
https://www.ncbi.nlm.nih.gov/pubmed/36124113
http://dx.doi.org/10.1155/2022/2988639
_version_ 1784791463452737536
author Liu, Lei
Sun, Yeguo
Liu, Yihong
Roxas, Rachel Edita O.
Raga, Rodolfo C.
author_facet Liu, Lei
Sun, Yeguo
Liu, Yihong
Roxas, Rachel Edita O.
Raga, Rodolfo C.
author_sort Liu, Lei
collection PubMed
description Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Referring to the current main solutions, this paper proposes a lightweight language model (EDA-BoB) based on text augmentation technology and knowledge understanding mechanism. Experiments show that the EDA-BoB model cannot only expand the scale of the training data set but also ensure the data quality at the cost of consuming little computing resources. Moreover, our model is shown to combine the contextual semantics of sentences to generate rich and accurate texts.
format Online
Article
Text
id pubmed-9482477
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-94824772022-09-18 Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding Liu, Lei Sun, Yeguo Liu, Yihong Roxas, Rachel Edita O. Raga, Rodolfo C. Comput Intell Neurosci Research Article Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Referring to the current main solutions, this paper proposes a lightweight language model (EDA-BoB) based on text augmentation technology and knowledge understanding mechanism. Experiments show that the EDA-BoB model cannot only expand the scale of the training data set but also ensure the data quality at the cost of consuming little computing resources. Moreover, our model is shown to combine the contextual semantics of sentences to generate rich and accurate texts. Hindawi 2022-09-10 /pmc/articles/PMC9482477/ /pubmed/36124113 http://dx.doi.org/10.1155/2022/2988639 Text en Copyright © 2022 Lei Liu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Liu, Lei
Sun, Yeguo
Liu, Yihong
Roxas, Rachel Edita O.
Raga, Rodolfo C.
Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title_full Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title_fullStr Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title_full_unstemmed Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title_short Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
title_sort research and implementation of text generation based on text augmentation and knowledge understanding
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9482477/
https://www.ncbi.nlm.nih.gov/pubmed/36124113
http://dx.doi.org/10.1155/2022/2988639
work_keys_str_mv AT liulei researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding
AT sunyeguo researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding
AT liuyihong researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding
AT roxasracheleditao researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding
AT ragarodolfoc researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding