Cargando…

Research on optimization of real-time efficient storage algorithm in data information serialization

BACKGROUND: Along with the vigorous development of Internet technology, increasing the functions of the various types of equipment, network communication easy and diversity, at the same time, the amount of data is very huge, under the network bandwidth limitations, through long lead to a data need t...

Descripción completa

Detalles Bibliográficos
Autores principales: Huang, Bin, Tang, You
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8675695/
https://www.ncbi.nlm.nih.gov/pubmed/34914712
http://dx.doi.org/10.1371/journal.pone.0260697
_version_ 1784615924328824832
author Huang, Bin
Tang, You
author_facet Huang, Bin
Tang, You
author_sort Huang, Bin
collection PubMed
description BACKGROUND: Along with the vigorous development of Internet technology, increasing the functions of the various types of equipment, network communication easy and diversity, at the same time, the amount of data is very huge, under the network bandwidth limitations, through long lead to a data need to be cut into more, one by one, transfer times, information delay problems. RESULTS: Aiming at the problems of poor data integrity, low efficiency and poor serialization efficiency of traditional data storage information, this article introduces Protobuf technology to study the serialization of data storage information. The serpentine gap method is used to complete the allocation interval of the sequence nodes, so that the working state and the resting state always maintain a dynamic balance. According to the first-level rules, the storage data of the completed target node is obtained, and the grammatical structure and the semantics of the target data are analyzed, Meanwhile corresponding correspondences are established, and the data storage information is serialized. In order to verify the effectiveness of Protobuf’s data storage information serialization method, a comparative experiment is designed. By using three methods of HDVM, Redis and Protobuf to serialize JSON data, the comparative analysis shows that HDVM has the longest processing time and Protobuf has the shortest processing time, and the data integrity is not affected. The simulation data shows that the Protobuf serialization method has short conversion time, high space utilization, and the Obvious advantages in correctness and integrity. It is vary suitable for serialization of JSON data in the case of limited bandwidth.
format Online
Article
Text
id pubmed-8675695
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-86756952021-12-17 Research on optimization of real-time efficient storage algorithm in data information serialization Huang, Bin Tang, You PLoS One Research Article BACKGROUND: Along with the vigorous development of Internet technology, increasing the functions of the various types of equipment, network communication easy and diversity, at the same time, the amount of data is very huge, under the network bandwidth limitations, through long lead to a data need to be cut into more, one by one, transfer times, information delay problems. RESULTS: Aiming at the problems of poor data integrity, low efficiency and poor serialization efficiency of traditional data storage information, this article introduces Protobuf technology to study the serialization of data storage information. The serpentine gap method is used to complete the allocation interval of the sequence nodes, so that the working state and the resting state always maintain a dynamic balance. According to the first-level rules, the storage data of the completed target node is obtained, and the grammatical structure and the semantics of the target data are analyzed, Meanwhile corresponding correspondences are established, and the data storage information is serialized. In order to verify the effectiveness of Protobuf’s data storage information serialization method, a comparative experiment is designed. By using three methods of HDVM, Redis and Protobuf to serialize JSON data, the comparative analysis shows that HDVM has the longest processing time and Protobuf has the shortest processing time, and the data integrity is not affected. The simulation data shows that the Protobuf serialization method has short conversion time, high space utilization, and the Obvious advantages in correctness and integrity. It is vary suitable for serialization of JSON data in the case of limited bandwidth. Public Library of Science 2021-12-16 /pmc/articles/PMC8675695/ /pubmed/34914712 http://dx.doi.org/10.1371/journal.pone.0260697 Text en © 2021 Huang, Tang https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Huang, Bin
Tang, You
Research on optimization of real-time efficient storage algorithm in data information serialization
title Research on optimization of real-time efficient storage algorithm in data information serialization
title_full Research on optimization of real-time efficient storage algorithm in data information serialization
title_fullStr Research on optimization of real-time efficient storage algorithm in data information serialization
title_full_unstemmed Research on optimization of real-time efficient storage algorithm in data information serialization
title_short Research on optimization of real-time efficient storage algorithm in data information serialization
title_sort research on optimization of real-time efficient storage algorithm in data information serialization
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8675695/
https://www.ncbi.nlm.nih.gov/pubmed/34914712
http://dx.doi.org/10.1371/journal.pone.0260697
work_keys_str_mv AT huangbin researchonoptimizationofrealtimeefficientstoragealgorithmindatainformationserialization
AT tangyou researchonoptimizationofrealtimeefficientstoragealgorithmindatainformationserialization