Cargando…

Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm

This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequa...

Descripción completa

Detalles Bibliográficos
Autores principales: Chmielowiec, Andrzej, Litwin, Paweł
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7997335/
https://www.ncbi.nlm.nih.gov/pubmed/33671035
http://dx.doi.org/10.3390/e23030296
_version_ 1783670305281015808
author Chmielowiec, Andrzej
Litwin, Paweł
author_facet Chmielowiec, Andrzej
Litwin, Paweł
author_sort Chmielowiec, Andrzej
collection PubMed
description This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities [Formula: see text]. Based on this result, we propose a simple coding using fixed length words. Its main application is the compression of random binary sequences with a large disproportion between the number of zeros and the number of ones. Importantly, the proposed solution allows for a much faster decompression compared with the Golomb-Rice coding with a relatively small decrease in the efficiency of compression. The proposed algorithm can be particularly useful for database applications for which the speed of decompression is much more important than the degree of index list compression.
format Online
Article
Text
id pubmed-7997335
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-79973352021-03-27 Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm Chmielowiec, Andrzej Litwin, Paweł Entropy (Basel) Article This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities [Formula: see text]. Based on this result, we propose a simple coding using fixed length words. Its main application is the compression of random binary sequences with a large disproportion between the number of zeros and the number of ones. Importantly, the proposed solution allows for a much faster decompression compared with the Golomb-Rice coding with a relatively small decrease in the efficiency of compression. The proposed algorithm can be particularly useful for database applications for which the speed of decompression is much more important than the degree of index list compression. MDPI 2021-02-28 /pmc/articles/PMC7997335/ /pubmed/33671035 http://dx.doi.org/10.3390/e23030296 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Chmielowiec, Andrzej
Litwin, Paweł
Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title_full Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title_fullStr Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title_full_unstemmed Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title_short Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
title_sort efficient inverted index compression algorithm characterized by faster decompression compared with the golomb-rice algorithm
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7997335/
https://www.ncbi.nlm.nih.gov/pubmed/33671035
http://dx.doi.org/10.3390/e23030296
work_keys_str_mv AT chmielowiecandrzej efficientinvertedindexcompressionalgorithmcharacterizedbyfasterdecompressioncomparedwiththegolombricealgorithm
AT litwinpaweł efficientinvertedindexcompressionalgorithmcharacterizedbyfasterdecompressioncomparedwiththegolombricealgorithm