Cargando…
Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources †
Since the entropy is a popular randomness measure, there are many studies for the estimation of entropies for given random samples. In this paper, we propose an estimation method of the Rényi entropy of order [Formula: see text]. Since the Rényi entropy of order [Formula: see text] is a generalized...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7513180/ https://www.ncbi.nlm.nih.gov/pubmed/33265746 http://dx.doi.org/10.3390/e20090657 |
_version_ | 1783586328894504960 |
---|---|
author | Kim, Young-Sik |
author_facet | Kim, Young-Sik |
author_sort | Kim, Young-Sik |
collection | PubMed |
description | Since the entropy is a popular randomness measure, there are many studies for the estimation of entropies for given random samples. In this paper, we propose an estimation method of the Rényi entropy of order [Formula: see text]. Since the Rényi entropy of order [Formula: see text] is a generalized entropy measure including the Shannon entropy as a special case, the proposed estimation method for Rényi entropy can detect any significant deviation of an ergodic stationary random source’s output. It is shown that the expected test value of the proposed scheme is equivalent to the Rényi entropy of order [Formula: see text]. After deriving a general representation of parameters of the proposed estimator, we discuss on the particular orders of Rényi entropy such as [Formula: see text] , [Formula: see text] , and [Formula: see text]. Because the Rényi entropy of order 2 is the most popular one, we present an iterative estimation method for the application with stringent resource restrictions. |
format | Online Article Text |
id | pubmed-7513180 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-75131802020-11-09 Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † Kim, Young-Sik Entropy (Basel) Article Since the entropy is a popular randomness measure, there are many studies for the estimation of entropies for given random samples. In this paper, we propose an estimation method of the Rényi entropy of order [Formula: see text]. Since the Rényi entropy of order [Formula: see text] is a generalized entropy measure including the Shannon entropy as a special case, the proposed estimation method for Rényi entropy can detect any significant deviation of an ergodic stationary random source’s output. It is shown that the expected test value of the proposed scheme is equivalent to the Rényi entropy of order [Formula: see text]. After deriving a general representation of parameters of the proposed estimator, we discuss on the particular orders of Rényi entropy such as [Formula: see text] , [Formula: see text] , and [Formula: see text]. Because the Rényi entropy of order 2 is the most popular one, we present an iterative estimation method for the application with stringent resource restrictions. MDPI 2018-08-31 /pmc/articles/PMC7513180/ /pubmed/33265746 http://dx.doi.org/10.3390/e20090657 Text en © 2018 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Kim, Young-Sik Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title | Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title_full | Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title_fullStr | Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title_full_unstemmed | Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title_short | Low Complexity Estimation Method of Rényi Entropy for Ergodic Sources † |
title_sort | low complexity estimation method of rényi entropy for ergodic sources † |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7513180/ https://www.ncbi.nlm.nih.gov/pubmed/33265746 http://dx.doi.org/10.3390/e20090657 |
work_keys_str_mv | AT kimyoungsik lowcomplexityestimationmethodofrenyientropyforergodicsources |