Cargando…
Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding
Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Re...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9482477/ https://www.ncbi.nlm.nih.gov/pubmed/36124113 http://dx.doi.org/10.1155/2022/2988639 |
_version_ | 1784791463452737536 |
---|---|
author | Liu, Lei Sun, Yeguo Liu, Yihong Roxas, Rachel Edita O. Raga, Rodolfo C. |
author_facet | Liu, Lei Sun, Yeguo Liu, Yihong Roxas, Rachel Edita O. Raga, Rodolfo C. |
author_sort | Liu, Lei |
collection | PubMed |
description | Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Referring to the current main solutions, this paper proposes a lightweight language model (EDA-BoB) based on text augmentation technology and knowledge understanding mechanism. Experiments show that the EDA-BoB model cannot only expand the scale of the training data set but also ensure the data quality at the cost of consuming little computing resources. Moreover, our model is shown to combine the contextual semantics of sentences to generate rich and accurate texts. |
format | Online Article Text |
id | pubmed-9482477 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-94824772022-09-18 Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding Liu, Lei Sun, Yeguo Liu, Yihong Roxas, Rachel Edita O. Raga, Rodolfo C. Comput Intell Neurosci Research Article Text generation has always been limited by the lack of corpus data required for language model (LM) training and the low quality of the generated text. Researchers have proposed some solutions, but these solutions are often complex and will greatly increase the consumption of computing resources. Referring to the current main solutions, this paper proposes a lightweight language model (EDA-BoB) based on text augmentation technology and knowledge understanding mechanism. Experiments show that the EDA-BoB model cannot only expand the scale of the training data set but also ensure the data quality at the cost of consuming little computing resources. Moreover, our model is shown to combine the contextual semantics of sentences to generate rich and accurate texts. Hindawi 2022-09-10 /pmc/articles/PMC9482477/ /pubmed/36124113 http://dx.doi.org/10.1155/2022/2988639 Text en Copyright © 2022 Lei Liu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Liu, Lei Sun, Yeguo Liu, Yihong Roxas, Rachel Edita O. Raga, Rodolfo C. Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title | Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title_full | Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title_fullStr | Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title_full_unstemmed | Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title_short | Research and Implementation of Text Generation Based on Text Augmentation and Knowledge Understanding |
title_sort | research and implementation of text generation based on text augmentation and knowledge understanding |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9482477/ https://www.ncbi.nlm.nih.gov/pubmed/36124113 http://dx.doi.org/10.1155/2022/2988639 |
work_keys_str_mv | AT liulei researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding AT sunyeguo researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding AT liuyihong researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding AT roxasracheleditao researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding AT ragarodolfoc researchandimplementationoftextgenerationbasedontextaugmentationandknowledgeunderstanding |