Cargando…
Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm
This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequa...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7997335/ https://www.ncbi.nlm.nih.gov/pubmed/33671035 http://dx.doi.org/10.3390/e23030296 |
_version_ | 1783670305281015808 |
---|---|
author | Chmielowiec, Andrzej Litwin, Paweł |
author_facet | Chmielowiec, Andrzej Litwin, Paweł |
author_sort | Chmielowiec, Andrzej |
collection | PubMed |
description | This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities [Formula: see text]. Based on this result, we propose a simple coding using fixed length words. Its main application is the compression of random binary sequences with a large disproportion between the number of zeros and the number of ones. Importantly, the proposed solution allows for a much faster decompression compared with the Golomb-Rice coding with a relatively small decrease in the efficiency of compression. The proposed algorithm can be particularly useful for database applications for which the speed of decompression is much more important than the degree of index list compression. |
format | Online Article Text |
id | pubmed-7997335 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-79973352021-03-27 Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm Chmielowiec, Andrzej Litwin, Paweł Entropy (Basel) Article This article deals with compression of binary sequences with a given number of ones, which can also be considered as a list of indexes of a given length. The first part of the article shows that the entropy H of random n-element binary sequences with exactly k elements equal one satisfies the inequalities [Formula: see text]. Based on this result, we propose a simple coding using fixed length words. Its main application is the compression of random binary sequences with a large disproportion between the number of zeros and the number of ones. Importantly, the proposed solution allows for a much faster decompression compared with the Golomb-Rice coding with a relatively small decrease in the efficiency of compression. The proposed algorithm can be particularly useful for database applications for which the speed of decompression is much more important than the degree of index list compression. MDPI 2021-02-28 /pmc/articles/PMC7997335/ /pubmed/33671035 http://dx.doi.org/10.3390/e23030296 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ). |
spellingShingle | Article Chmielowiec, Andrzej Litwin, Paweł Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title | Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title_full | Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title_fullStr | Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title_full_unstemmed | Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title_short | Efficient Inverted Index Compression Algorithm Characterized by Faster Decompression Compared with the Golomb-Rice Algorithm |
title_sort | efficient inverted index compression algorithm characterized by faster decompression compared with the golomb-rice algorithm |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7997335/ https://www.ncbi.nlm.nih.gov/pubmed/33671035 http://dx.doi.org/10.3390/e23030296 |
work_keys_str_mv | AT chmielowiecandrzej efficientinvertedindexcompressionalgorithmcharacterizedbyfasterdecompressioncomparedwiththegolombricealgorithm AT litwinpaweł efficientinvertedindexcompressionalgorithmcharacterizedbyfasterdecompressioncomparedwiththegolombricealgorithm |