Cargando…

Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †

This paper establishes a close relationship among the four information theoretic problems, namely Campbell source coding, Arikan guessing, Huleihel et al. memoryless guessing and Bunte and Lapidoth tasks’ partitioning problems in the IID-lossless case. We first show that the aforementioned problems...

Descripción completa

Detalles Bibliográficos
Autores principales: Ashok Kumar, M., Sunny, Albert, Thakre, Ashish, Kumar, Ashisha, Dinesh Manohar, G.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9689969/
https://www.ncbi.nlm.nih.gov/pubmed/36421550
http://dx.doi.org/10.3390/e24111695
_version_ 1784836668718579712
author Ashok Kumar, M.
Sunny, Albert
Thakre, Ashish
Kumar, Ashisha
Dinesh Manohar, G.
author_facet Ashok Kumar, M.
Sunny, Albert
Thakre, Ashish
Kumar, Ashisha
Dinesh Manohar, G.
author_sort Ashok Kumar, M.
collection PubMed
description This paper establishes a close relationship among the four information theoretic problems, namely Campbell source coding, Arikan guessing, Huleihel et al. memoryless guessing and Bunte and Lapidoth tasks’ partitioning problems in the IID-lossless case. We first show that the aforementioned problems are mathematically related via a general moment minimization problem whose optimum solution is given in terms of Renyi entropy. We then propose a general framework for the mismatched version of these problems and establish all the asymptotic results using this framework. The unified framework further enables us to study a variant of Bunte–Lapidoth’s tasks partitioning problem which is practically more appealing. In addition, this variant turns out to be a generalization of Arıkan’s guessing problem. Finally, with the help of this general framework, we establish an equivalence among all these problems, in the sense that, knowing an asymptotically optimal solution in one problem helps us find the same in all other problems.
format Online
Article
Text
id pubmed-9689969
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96899692022-11-25 Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? † Ashok Kumar, M. Sunny, Albert Thakre, Ashish Kumar, Ashisha Dinesh Manohar, G. Entropy (Basel) Article This paper establishes a close relationship among the four information theoretic problems, namely Campbell source coding, Arikan guessing, Huleihel et al. memoryless guessing and Bunte and Lapidoth tasks’ partitioning problems in the IID-lossless case. We first show that the aforementioned problems are mathematically related via a general moment minimization problem whose optimum solution is given in terms of Renyi entropy. We then propose a general framework for the mismatched version of these problems and establish all the asymptotic results using this framework. The unified framework further enables us to study a variant of Bunte–Lapidoth’s tasks partitioning problem which is practically more appealing. In addition, this variant turns out to be a generalization of Arıkan’s guessing problem. Finally, with the help of this general framework, we establish an equivalence among all these problems, in the sense that, knowing an asymptotically optimal solution in one problem helps us find the same in all other problems. MDPI 2022-11-19 /pmc/articles/PMC9689969/ /pubmed/36421550 http://dx.doi.org/10.3390/e24111695 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ashok Kumar, M.
Sunny, Albert
Thakre, Ashish
Kumar, Ashisha
Dinesh Manohar, G.
Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title_full Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title_fullStr Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title_full_unstemmed Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title_short Are Guessing, Source Coding and Tasks Partitioning Birds of A Feather? †
title_sort are guessing, source coding and tasks partitioning birds of a feather? †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9689969/
https://www.ncbi.nlm.nih.gov/pubmed/36421550
http://dx.doi.org/10.3390/e24111695
work_keys_str_mv AT ashokkumarm areguessingsourcecodingandtaskspartitioningbirdsofafeather
AT sunnyalbert areguessingsourcecodingandtaskspartitioningbirdsofafeather
AT thakreashish areguessingsourcecodingandtaskspartitioningbirdsofafeather
AT kumarashisha areguessingsourcecodingandtaskspartitioningbirdsofafeather
AT dineshmanoharg areguessingsourcecodingandtaskspartitioningbirdsofafeather