Cargando…

Smoothing of Binary Codes, Uniform Distributions, and Applications

The action of a noise operator on a code transforms it into a distribution on the respective space. Some common examples from information theory include Bernoulli noise acting on a code in the Hamming space and Gaussian noise acting on a lattice in the Euclidean space. We aim to characterize the cas...

Descripción completa

Detalles Bibliográficos
Autores principales: Pathegama, Madhura, Barg, Alexander
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670042/
https://www.ncbi.nlm.nih.gov/pubmed/37998208
http://dx.doi.org/10.3390/e25111515
_version_ 1785139830729998336
author Pathegama, Madhura
Barg, Alexander
author_facet Pathegama, Madhura
Barg, Alexander
author_sort Pathegama, Madhura
collection PubMed
description The action of a noise operator on a code transforms it into a distribution on the respective space. Some common examples from information theory include Bernoulli noise acting on a code in the Hamming space and Gaussian noise acting on a lattice in the Euclidean space. We aim to characterize the cases when the output distribution is close to the uniform distribution on the space, as measured by the Rényi divergence of order [Formula: see text]. A version of this question is known as the channel resolvability problem in information theory, and it has implications for security guarantees in wiretap channels, error correction, discrepancy, worst-to-average case complexity reductions, and many other problems. Our work quantifies the requirements for asymptotic uniformity (perfect smoothing) and identifies explicit code families that achieve it under the action of the Bernoulli and ball noise operators on the code. We derive expressions for the minimum rate of codes required to attain asymptotically perfect smoothing. In proving our results, we leverage recent results from harmonic analysis of functions on the Hamming space. Another result pertains to the use of code families in Wyner’s transmission scheme on the binary wiretap channel. We identify explicit families that guarantee strong secrecy when applied in this scheme, showing that nested Reed–Muller codes can transmit messages reliably and securely over a binary symmetric wiretap channel with a positive rate. Finally, we establish a connection between smoothing and error correction in the binary symmetric channel.
format Online
Article
Text
id pubmed-10670042
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106700422023-11-05 Smoothing of Binary Codes, Uniform Distributions, and Applications Pathegama, Madhura Barg, Alexander Entropy (Basel) Article The action of a noise operator on a code transforms it into a distribution on the respective space. Some common examples from information theory include Bernoulli noise acting on a code in the Hamming space and Gaussian noise acting on a lattice in the Euclidean space. We aim to characterize the cases when the output distribution is close to the uniform distribution on the space, as measured by the Rényi divergence of order [Formula: see text]. A version of this question is known as the channel resolvability problem in information theory, and it has implications for security guarantees in wiretap channels, error correction, discrepancy, worst-to-average case complexity reductions, and many other problems. Our work quantifies the requirements for asymptotic uniformity (perfect smoothing) and identifies explicit code families that achieve it under the action of the Bernoulli and ball noise operators on the code. We derive expressions for the minimum rate of codes required to attain asymptotically perfect smoothing. In proving our results, we leverage recent results from harmonic analysis of functions on the Hamming space. Another result pertains to the use of code families in Wyner’s transmission scheme on the binary wiretap channel. We identify explicit families that guarantee strong secrecy when applied in this scheme, showing that nested Reed–Muller codes can transmit messages reliably and securely over a binary symmetric wiretap channel with a positive rate. Finally, we establish a connection between smoothing and error correction in the binary symmetric channel. MDPI 2023-11-05 /pmc/articles/PMC10670042/ /pubmed/37998208 http://dx.doi.org/10.3390/e25111515 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pathegama, Madhura
Barg, Alexander
Smoothing of Binary Codes, Uniform Distributions, and Applications
title Smoothing of Binary Codes, Uniform Distributions, and Applications
title_full Smoothing of Binary Codes, Uniform Distributions, and Applications
title_fullStr Smoothing of Binary Codes, Uniform Distributions, and Applications
title_full_unstemmed Smoothing of Binary Codes, Uniform Distributions, and Applications
title_short Smoothing of Binary Codes, Uniform Distributions, and Applications
title_sort smoothing of binary codes, uniform distributions, and applications
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670042/
https://www.ncbi.nlm.nih.gov/pubmed/37998208
http://dx.doi.org/10.3390/e25111515
work_keys_str_mv AT pathegamamadhura smoothingofbinarycodesuniformdistributionsandapplications
AT bargalexander smoothingofbinarycodesuniformdistributionsandapplications