Information entropy and temperature of binary Markov chains

O. V. Usatenko, S. S. Melnyk, G. M. Pritula, and V. A. Yampol'skii
Phys. Rev. E 106, 034127 – Published 19 September 2022

Abstract

We propose two different approaches for introducing the information temperature of binary Nth-order Markov chains. The first approach is based on a comparison of Markov sequences with equilibrium Ising chains at given temperatures. The second approach uses probabilities of finite-length subsequences of symbols occurring, which determine their entropies. The derivative of the entropy with respect to the energy gives the information temperature measured on the scale of introduced energy. For the case of a nearest-neighbor spin-symbol interaction, both approaches give similar results. However, the method based on the correspondence of the N-step Markov and Ising chains appears to be very cumbersome for N>3. We also introduce the information temperature for the weakly correlated one-parametric Markov chains and present results for the stepwise and power memory functions. An application of the developed method to obtain the information temperature of some literary texts is given.

  • Figure
  • Received 29 May 2022
  • Accepted 17 August 2022

DOI:https://doi.org/10.1103/PhysRevE.106.034127

©2022 American Physical Society

Physics Subject Headings (PhySH)

Statistical Physics & ThermodynamicsInterdisciplinary PhysicsNetworksPhysics of Living Systems

Authors & Affiliations

O. V. Usatenko1,*, S. S. Melnyk1, G. M. Pritula1, and V. A. Yampol'skii1,2

  • 1A. Ya. Usikov Institute for Radiophysics and Electronics NASU, 61085 Kharkov, Ukraine
  • 2V. N. Karazin Kharkov National University, 61077 Kharkov, Ukraine

  • *Present address: Department of Physics, University of Florida, Gainesville, Florida 32611-8440, USA.

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 106, Iss. 3 — September 2022

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review E

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×