Abstract
A long-standing question in applications of dynamical systems theory is how to distinguish noisy signals from chaotic steady states. Information-theoretic measures hold promise to resolve this problem. We apply two such measures to numerically computed phase-space trajectories of continuous-state nonlinear oscillators: forecasting or statistical complexity, which quantifies the minimum memory required for the optimal prediction of discrete observables, and the entropy rate, which quantifies their intrinsic unpredictability. We estimate empirical generating partitions to obtain discrete observables faithfully representing continuous-state chaotic time series. We focus on the problem of distinguishing stochastically perturbed periodic orbits from chaotic attractors that exist at nearby parameter values, in a region of the parameter space where a strange invariant set exists. We find that a stochastically perturbed, stable, high-period (\(p=15\)) orbit of a periodically driven Duffing oscillator admits high values of both information measures, making it difficult to distinguish it from chaotic states at adjacent parameters, even with small noise. However, for a low-period (\(p=3\)) orbit, such a distinction becomes easier, as both measures admit considerably lower values compared to a chaotic attractor at a nearby parameter. Furthermore, the forecasting complexity of the selected periodic orbits increases with noise as they undergo a transition to “noise-induced chaos.” For sufficiently high noise levels, our ability to distinguish chaos from noise depends on model-order selection when estimating forecasting complexity and also on the exact choice of discrete observables used to encode phase-space trajectories.
Similar content being viewed by others
Notes
Considering \(\delta \in [0.2,0.6]\) as a bifurcation parameter, we also estimated \(h_{\mu }\) values for about 300 chaotic attractors using the CSSR algorithm (\(N=2\times 10^6\)), as done here for \(\delta =0.25\): \(h_{\mu }\) values were higher than \(\lambda _1\) by \(\approx 4 \%\) (averaged over all \(\delta \) parameters) [26].
References
Abad, A., Barrio, R., Blesa, F., Rodríguez, M.: Algorithm 924: TIDES, a Taylor series integrator for differential equations. ACM Trans. Math. Softw. 39(1), 1–28 (2012). https://doi.org/10.1145/2382585.2382590
Ash, R.B.: Information Theory. Dover, New York (1965)
Badii, R., Politi, A.: Complexity: Hierarchical Structures and Scaling in Physics. Cambridge University Press, Cambridge (1997)
Barreira, L., Pesin, Y.: Nonuniform Hyperbolicity: Dynamics of Systems with Nonzero Lyapunov Exponents. Encyclopedia of Mathematics and Its Applications. Cambridge University Press, Cambridge (2007)
Billingsley, P.: Ergodic Theory and Information. Wiley, New York (1965)
Cash, J.R., Karp, A.H.: A variable order Runge–Kutta method for initial value problems with rapidly varying right-hand sides. ACM Trans. Math. Softw. 16(3), 201–222 (1990). https://doi.org/10.1145/79505.79507
Cencini, M., Falcioni, M., Olbrich, E., Kantz, H., Vulpiani, A.: Chaos or noise: difficulties of a distinction. Phys. Rev. E 62(1), 427–437 (2000). https://doi.org/10.1103/PhysRevE.62.427
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley-Interscience, Hoboken (1991)
Crutchfield, J.P.: The calculi of emergence: computation, dynamics and induction. Physica D 75(1–3), 11–54 (1994). https://doi.org/10.1016/0167-2789(94)90273-9
Crutchfield, J.P., Young, K.: Inferring statistical complexity. Phys. Rev. Lett. 63(2), 105–108 (1989). https://doi.org/10.1103/PhysRevLett.63.105
Eckmann, J.P., Ruelle, D.: Ergodic theory of chaos and strange attractors. Rev. Mod. Phys. 57(3), 617–656 (1985). https://doi.org/10.1103/RevModPhys.57.617
Fraser, A.M.: Hidden Markov Models and Dynamical Systems. SIAM Press, Philadelphia (2008)
Gao, J., Cao, Y., Tung, W., Hu, J.: Multiscale Analysis of Complex Time Series: Integration of Chaos and Random Fractal Theory, and Beyond. Wiley, Hoboken (2007)
Grassberger, P.: Toward a quantitative theory of self-generated complexity. Int. J. Theor. Phys. 25(9), 907–938 (1986). https://doi.org/10.1007/BF00668821
Haslinger, R., Klinkner, K.L., Shalizi, C.R.: The computational structure of spike trains. Neural Comput. 22(1), 121–157 (2010). https://doi.org/10.1162/neco.2009.12-07-678
Hegger, R., Kantz, H., Schreiber, T.: Practical implementation of nonlinear time series methods: the TISEAN package. Chaos 9(2), 413–435 (1999). https://doi.org/10.1063/1.166424
Higham, D.J.: An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev. 43(3), 525–546 (2001). https://doi.org/10.1137/S0036144500378302
Kantz, H., Schreiber, T.: Nonlinear Time Series Analysis, 2nd edn. Cambridge University Press, Cambridge (2004)
Kloeden, P.E., Platen, E.: Numerical Solution of Stochastic Differential Equations, Stochastic Modelling and Applied Probability, vol. 23. Springer, Berlin (1992)
Lempel, A., Ziv, J.: On the complexity of finite sequences. IEEE Trans. Inf. Theory 22(1), 75–81 (1976). https://doi.org/10.1109/TIT.1976.1055501
Lewis, H.R., Papadimitriou, C.H.: Elements of the Theory of Computation, 2nd edn. Prentice-Hall, Upper Saddle River (1997)
Marton, K., Shields, P.C.: Entropy and the consistent estimation of joint distributions. Ann. Probab. 22(2), 960–977 (1994). https://doi.org/10.1214/aop/1176988736. Correction. Ann. Probab. 24(1), 541–545. (1996)
Milstein, G.N., Tretyakov, M.V.: Stochastic Numerics for Mathematical Physics. Scientific Computation. Springer, Berlin (2004)
Olivares, F., Plastino, A., Rosso, O.A.: Contrasting chaos with noise via local versus global information quantifiers. Phys. Lett. A 376(19), 1577–1583 (2012). https://doi.org/10.1016/j.physleta.2012.03.039
Ott, E.: Chaos in Dynamical Systems, 2nd edn. Cambridge University Press, Cambridge (2002). https://doi.org/10.1017/CBO9780511803260
Patil, N.S.: Coarse-grained models of nonlinear oscillators. PhD Thesis, The Pennsylvania State University, University Park, PA, USA (2017). https://etda.libraries.psu.edu/catalog/14005nsp129
Patil, N.S., Cusumano, J.P.: Empirical generating partitions of driven oscillators using optimized symbolic shadowing. Phys. Rev. E 98(3), 032211 (2018). https://doi.org/10.1103/PhysRevE.98.032211
Petersen, K.E.: Ergodic theory. In: Cambridge Studies in Advanced Mathematics (No. 2). Cambridge University Press, Cambridge (1983)
Politi, A.: Quantifying the dynamical complexity of chaotic time series. Phys. Rev. Lett. 118, 144101 (2017). https://doi.org/10.1103/PhysRevLett.118.144101
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes in C: The Art of Scientific Computing, 2nd edn. Cambridge University Press, New York (1992)
Rößler, A.: Runge–Kutta methods for the strong approximation of solutions of stochastic differential equations. SIAM J. Numer. Anal. 48(3), 922–952 (2010). https://doi.org/10.1137/09076636X
Rosso, O.A., Larrondo, H.A., Martin, M.T., Plastino, A., Fuentes, M.A.: Distinguishing noise from chaos. Phys. Rev. Lett. 99, 154102 (2007). https://doi.org/10.1103/PhysRevLett.99.154102
Shalizi, C.R., Crutchfield, J.P.: Computational mechanics: pattern and prediction, structure and simplicity. J. Stat. Phys. 104, 817–879 (2001). https://doi.org/10.1023/A:1010388907793
Shalizi, C.R., Klinkner, K.L.: Blind construction of optimal nonlinear recursive predictors for discrete sequences. In: Chickering, M., Halpern, J.Y. (eds.) Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence (UAI 2004), pp. 504–511 (2004). arXiv:1408.2025
Shalizi, C.R., Shalizi, K.L., Crutchfield, J.P.: An algorithm for pattern discovery in time series. SFI Working Paper 02-10-060, Santa Fe Institute (2002). arXiv:cs/0210025
Solari, H.G., Gilmore, R.: Organization of periodic orbits in the driven Duffing oscillator. Phys. Rev. A 38, 1566–1572 (1988). https://doi.org/10.1103/PhysRevA.38.1566
Sugihara, G., May, R.M.: Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series. Nature 344(6268), 734–741 (1990). https://doi.org/10.1038/344734a0
Tél, T., Lai, Y.C., Gruiz, M.: Noise-induced chaos: a consequence of long deterministic transients. Int. J. Bifurc. Chaos 18(02), 509–520 (2008). https://doi.org/10.1142/S0218127408020422
Zambella, D., Grassberger, P.: Complexity of forecasting in a class of simple models. Complex Syst. 2(3), 269–303 (1988)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A: A custom SRK scheme for the numerical integration of the SDEs with additive noise
Appendix A: A custom SRK scheme for the numerical integration of the SDEs with additive noise
Our custom six-stage SRK scheme of global (stochastic) order 1.5 and deterministic order 5 yields a discrete approximation, \({{\varvec{y}}}_1^M {:}{=}\{{{\varvec{y}}}_r: r = 1,2,\ldots ,M\}\) at times \(\{t_r = rh\}\), of the solution trajectory of the SDEs (1) with constant additive noise (i.e., \({{\varvec{g}}}=\text {constant}\)) given by:
with stages, for \(i = 1,2,\ldots ,6\),
where the method coefficients: \({{\varvec{c}}}\), \({{\varvec{\alpha }}}\), and \({{\varvec{A}}}\), are from Table 1; the 6-by-1 coefficient vector \({{\varvec{B}}e}\) is in Table 2; \({{\varvec{y}}}_0 {:}{=}{{\varvec{x}}}(0)\); and h is the time step. The random variables, \(I_{(1)}\) and \(I_{(1,0)}\), are the Itô stochastic integrals, exactly modeled [19, 23] as:
where \(\zeta _1, \zeta _2\) are independent standard normal random variables. The iterate of the Poincaré map \({{\varvec{F}}}_{\pi }^{\sigma }\) (Eq. 3) at the end of the \(n^{\text {th}}\) half-period of the forcing is obtained as: \({{\varvec{x}}}_n=-{{\varvec{y}}}_M\), where \({{\varvec{y}}}_M\) is found iteratively using Eq. (19).
Rights and permissions
About this article
Cite this article
Patil, N.S., Cusumano, J.P. The high forecasting complexity of stochastically perturbed periodic orbits limits the ability to distinguish them from chaos. Nonlinear Dyn 102, 697–712 (2020). https://doi.org/10.1007/s11071-020-05920-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-020-05920-z