Abstract
We consider the problem of determining extreme values of the Rényi entropy for a discrete random variable provided that the value of the α-coupling for this random variable and another one with a given probability distribution is fixed.
Similar content being viewed by others
References
Rényi, A., On Measures of Entropy and Information, Proc. 4th Berkeley Sympos. on Mathematical Statistics and Probability, Berkely, CA, USA, June 20–July 30, 1960, Neyman, J., Ed., Berkely: Univ. of California Press, 1961, vol. 1: Contributions to the Theory of Statistics, pp. 547–561.
Aczél, J. and Daróczy, Z., On Measures of Information and Their Characterization, New York: Academic, 1975.
Prelov, V.V., On One Extreme Value Problem for Entropy and Error Probability, Probl. Peredachi Inf., 2014, vol. 50, no. 3, pp. 3–18 [Probl. Inf. Transm. (Engl. Transl.), 2014, vol. 50, no. 3, pp. 203–216].
Ho, S.-W. and Yeung, R.W., The Interplay between Entropy and Variational Distance, IEEE Trans. Inform. Theory, 2010, vol. 56, no. 12, pp. 5906–5929.
Marshall, A.W., Olkin, I., and Arnold, B.C., Inequalities: Theory of Majorization and Its Applications, New York: Springer, 2011.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Prelov, V.V. On Extreme Values of the Rényi Entropy under Coupling of Probability Distributions. Probl Inf Transm 55, 46–52 (2019). https://doi.org/10.1134/S0032946019010022
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0032946019010022