Abstract
We use asymptotic methods from the theory of differential equations to obtain an analytical expression for the survival probability of an Ornstein–Uhlenbeck process with a potential defined over a broad domain. We form a uniformly continuous analytical solution covering the entire domain by asymptotically matching approximate solutions in an interior region, centered around the origin, to those in boundary layers, near the lateral boundaries of the domain. The analytic solution agrees extremely well with the numerical solution and takes into account the non-negligible leakage of probability that occurs at short times when the stochastic process begins close to one of the boundaries. Given the range of applications of Ornstein–Uhlenbeck processes, the analytic solution is of broad relevance across many fields of natural and engineering science.
Similar content being viewed by others
1 Introduction
The generalized Ornstein–Uhlenbeck (OU) model describes a stochastic process with at least one equilibrium point. It provides a framework for a wide range of physical, biological and social systems, wherein stabilization is viewed in terms of a potential minimum, characterized by a negative Lyapunov exponent, and high-frequency fluctuations are interpreted in terms of specific noise forcing. For example, an OU process is used to study neuronal activity [1] and the time-evolution of trait values towards their evolutionary optima [2]. In a clinical setting the health of the hepatic dynamic equilibrium is fit to an OU process using maximum likelihood estimation [3]. Stochastic volatility, crucial for deducing stock returns or option pricing, is treated in terms of an OU process [4], as are the noise spectra of climate observations [5,6,7].
A particular stochastic model is commonly studied in terms of the survival probability, which is associated with the probability of one or more events occurring, or for the system to reach a defined threshold for the first time starting from a given initial position. Due to the generality of the question it addresses, survival analysis has been widely used in science and engineering. Examples include Feshbach resonances and the quantum Zeno effect (for example [8,9,10]), engineering reliability analysis [11], financial risk management [12], and event history analysis in sociology [13]. Moreover, in the specific case of an OU process survival analyses from neuroscience [14] and epidemiology [15, 16] to quantitative finance [17,18,19] and extreme value statistics of correlated random variables [20] demonstrate the ubiquity of the approach. Our survival analysis is broadly relevant to all systems that can be described by an OU process. For example, it can be shown [21] that the survival probability of Brownian motion with an absorbing boundary that moves in time t as \(\propto \sqrt{t}\) can be recast as an OU process with a fixed absorbing boundary using Lamperti’s (or Doob’s) transformation.
Let \(\{X(t),\, t \ge 0\}\) be an OU process starting at x. The time it takes for the state of a system to encounter a threshold \({X(t)=\beta }\) for the first time is variously called the first hitting time or first passage time, whose probability distribution function \({\zeta (t,x)}\), is defined as
where
The time integral of the probability distribution of the first passage time is the survival probability (see for example [22,23,24,25] for reviews).
Despite the broad applicability of the survival probability, a simple accurate analytical expression has been lacking, which is the primary motivation of our work. The exact mathematical form is constructed using the Laplace transform and its inverse, which results in a series expansion of special functions [26]. However, its complexity confounds practical implementation. In particular, when the initial data are close to the boundary of the confining potential [27], or when the boundary itself is near the equilibrium point [28], one must retain a considerable number of terms in the expansion.
Our treatment of survival probability is shown in the schematic potential of Fig. 1, which contains a particle governed by a one-dimensional Ornstein–Uhlenbeck process through an overdamped autonomous Langevin equation given by
where a and b are positive constants and \(\xi (t)\) is Gaussian white noise with a zero mean and \(\langle \xi (t)\xi (s)\rangle =\delta (t-s)\).
The survival probability commonly characterizes the anomalous or abnormal behavior of a system. This motivates our consideration of a threshold state (\({X=\beta }\)) far from the equilibrium state (\({X(t)=0}\)), so that it is rare that the system will reach the threshold.
The next section is devoted to our overall approach. In Sect. 2.1 we summarize our method. In Sect. 2.2 we briefly review previous results on the survival probability of an OU process that will be used in Sect. 2.3 to derive a simple analytical expression that reproduces the survival probability for large values of the domain boundaries and when the initial data are close to the boundary. In Sect. 2.4 we compare the analytical and numerical results.
2 Using Matched Asymptotic Methods to Determine the Survival Probability
2.1 Summary of Analytical Method
Our approach is as follows. As shown in Fig. 1 we divide the domain into two regions [29]: a broad O(1) region (I) containing the minimum of the potential, \({X=0}\), and a narrow \(O\left( {1}/{\beta }\right) \) boundary layer near \({X=\beta }\). We solve the limiting differential equations in these regions, from which we develop a uniform composite solution for the probability density of the survival probability using asymptotic matching, which is a highly accurate general analytical method [30], recently used to obtain the solution to the related problem of stochastic resonance [31].
2.2 Previous Results on the Survival Probability of an OU Process
The canonical approach of finding the survival probability of this OU process is to determine the probability distribution for the first hitting time in Laplace space
which leads to the following analytical expression [32,33,34],
where \(D_{\lambda }(z)\) is the parabolic cylinder function, \(\beta \) is the boundary position and x is the initial position.
This equation can be written as a spectral decomposition [35], wherein the countable number of eigenvalues correspond to the zeros of the denominator of Eq. (5). The final expression for the probability distribution of the first hitting time can be obtained by inverting each term of this spectral decomposition, which can be written as a weighted sum of exponential functions as
where \(\lambda _p(\beta )\) is the solution of
and \(\varPhi \) and \(\varPhi '\) are defined in [35] in terms of Kummer and digamma functions.
For large values of t and \(\beta -x\), Eq. (6) simplifies considerably. In fact, because all the eigenvalues, \(\lambda _p(\beta )\), are negative, only that with the smallest magnitude will contribute significantly as \(t \rightarrow \infty \). Moreover, for large values of \(\beta -x\), Eq. (6) becomes
where \(t_1(\beta ;0)\) is the mean first passage time of the process from \(X(t=0)=0\) to the boundary \(\beta \) [36].
Importantly, however, the asymptotic expression in Eq. (8) is not valid when \(x\approx \beta \). Indeed, as we show here, when the process starts in the neighborhood of \(x=\beta \) there is a non-trivial leakage of probability. This leakage is not taken into account by Eq. (8) and transpires very rapidly, on a time scale of order \(1/\beta ^2\). Therefore, taking this approach requires that one calculate an enormous number of eigenvalues in Eq. (6), which is computationally inefficient. Our approach avoids this problem.
2.3 Detailed Development of the Approach
We derive an asymptotic expression for the survival probability, which is the time integral of the probability distribution of the first passage time, and in the large \(\beta \) limit it is trivial to evaluate when \(x\approx \beta \).
The probability density, \(\rho (y,t;x,s)\), of the OU process in Eq. (3) is described by the Kolmogorov forward (KFE) and backward (KBE) equations, the former of which is
where the operator \({\mathcal {L}}_y\) is the generator of the OU process viz., \([{\mathcal {L}}_y f](y,t)=a~\partial _y [y f(y,t)]+b~\partial _{yy}f(y,t)\). The KBE follows by replacing \({\mathcal {L}}_y\) with its adjoint, \({\mathcal {L}}_x^*\), defined as \([{\mathcal {L}}_x^* f](x,s)=-ax~\partial _x f(x,s)+b~\partial _{xx}f(x,s)\).
The KFE gives the evolution of the probability density of the process when the initial position and time, (x, s), are known, while the KBE treats the evolution when the final position and time, (y, t), are known. Both equations have initial condition
and boundary conditions
for the KFE and the KBE respectively.
The survival probability within the interval \((\alpha ,\beta )\) is defined in terms of the KBE density, \(\rho _{KBE}\), as
which satisfies
with initial condition
and boundary conditions
where \(\varTheta (\cdot )\) is the Heaviside theta function.
Let \(P_i^\alpha (P_i^\beta )\) be the probability of hitting \(x=\alpha (\beta )\) for the first time after i time steps and let \(S^\alpha (S^\beta )\) be the survival probability with an absorbing boundary at \(x=\alpha (\beta )\). Hence, if we discretize the stochastic process, the survival probability after n time steps is
In the second line of Eq. (16), we have neglected the term \(P_i^\alpha P_i^\beta \) for \(|\alpha |\gg 1\) and \(|\beta | \gg 1\), allowing us to write the survival probability in the interval \((\alpha , \beta )\) as the product of the two survival probabilities in the two intervals \((-\infty , \beta )\) and \((\alpha , \infty )\) with \(\alpha <\beta \). From this point on we will only consider the survival probability in the interval \((-\infty , \beta )\), and note that the derivation for the interval \((\alpha , \infty )\) follows in straightforward analogy.
We now rewrite Eq. (13) in a rescaled form,
with the new variables,
in which the spatial coordinate is expressed in terms of the standard deviation \(\sigma =\sqrt{b/a}\) of a stationary OU process obtained from the solution of Eq. (9) in the limit \(t \rightarrow \infty \). The new initial and boundary conditions are
We solve the limiting differential equations within the two regions, from which we construct an approximate uniform solution by asymptotic matching. We denote \(S_{\text {out}}(x,t)\) and \(S_{\text {in}}(x,t)\) as the solutions in region I and II respectively.
Region I. The outer solution is obtained by imposing \(\beta -x \gg 1\). In this limit the probability distribution of the first hitting time in Eq. (8) is valid, and its time integral gives the survival probability as
where the rescaled \(\beta \) and t of Eq. (18) have been used.
Region II. In the boundary layer, or the inner region, we have \(x \sim \beta \), where the approximation of Region I is no longer valid. We let \(\epsilon \equiv 1/\beta \ll 1\) and introduce the following stretched coordinates,
that we use to rewrite Eq. (17) as
which at leading-order becomes
Clearly, Eq. (23) is a diffusion equation for \(S_{\text {in}}(\eta ,\theta )\) along the characteristics
which we can then write as
wherein \(\mu \equiv \eta -\theta \) and \(\rho \equiv \theta \), so that the boundary condition becomes \(S_{\text {in}}(\mu =-\rho ,\rho )=0\).
We solve Eq. (25) by first finding its Green’s function, \(G(\rho ,\mu ;\nu )\), which satisfies
This Green’s function is associated with the probability density \(\rho _{KBE}\), satisfying the KBE, and hence the survival probability through Eq. (12). Hence, this density satisfies the following conditions;
The Green’s function is (e.g., [37])
which, as noted above, now allows us to write the solution of Eq. (25) as
Upon integration and reversion to the original variable t and to the stretched coordinate \(\eta \), we find
We determine the constant K by requiring the outer limit of the inner solution to equal the outer solution;
Therefore, the uniformly valid approximate composite analytical solution for the survival probability is
written in terms of the original spatial coordinate x rather that the stretched coordinate \(\eta \).
2.4 Comparing Analytical and Numerical Results
We compare Eq. (32) with the numerical solution of Eq. (17) for different values of the parameter \(\beta \) in Fig. 2, and find excellent agreement even when \(\beta \) is not asymptotically large. Indeed, the smallest value of the distance to the boundary is \(\beta =1.645 \sigma \), corresponding to a \(90\%\) probability that an unbounded stationary OU process remains below the boundary.
When \(t\gg 1/\beta ^2\) the left hand side of Eq. (23) is negligible and Eq. (32) becomes \(S_{\text {out}}(t)[1-e^{\beta (x-\beta )}]\) and depends on time solely through \(S_{\text {out}}(t)\), which is the prefactor of \(S_{\text {in}}(x,t)\). Thus, depending on x the rate of the decrease in the survival probability is controlled by \(S_{\text {in}}(x,t)\), decaying more rapidly near the boundary for early times.
The accuracy of the asymptotic solutions over a wide range of the \(\beta \) facilitates simple and wide ranging applications. For example, determining the input parameters of a leaky integrate-and-fire (LIF) neural model (see e.g., [38] and refs therein) based on experimentally observable interspike intervals [28]. Of particular contemporary relevance is deducing the “critical community size” in disease epidemiology [27], or the population threshold below which infections do not persist.
Finally, we appeal to Eq. (16) to form the asymptotic expression for the survival probability of an Ornstein–Uhlenbeck process with two absorbing boundaries as
We note that only one of the boundary regions will contribute significantly viz.,
where \(h_{\alpha (\beta )}=x-\alpha (\beta )\).
In Fig. 2d we show that the numerical solution with two boundaries matches that obtained by considering the two boundaries separately and with the analytical solution in Eq. (33).
3 Conclusion
We have obtained an asymptotic analytical solution for the survival probability of an Ornstein–Uhlenbeck process for large potentials. We divide the potential into two layers near the boundaries and a broad region between, which contains the origin, where we use the solution of Ricciardi and Sato [35]. The uniformly continuous solution is obtained by matching the two approximate solutions in the boundary layers with that in the broad region between. The solution agrees extremely well with both the numerical solution and with the more restricted asymptotic expression for the survival probability known in literature. Importantly, our analysis remains valid even when the initial position of the stochastic process is close to one of the boundaries, and furthermore it takes into account the non-negligible leakage of the probability early in the time evolution.
Despite the analysis using the assumption of asymptotically large boundaries, we showed that it agrees well with the numerical solution, even when the boundary positions are the same order of magnitude as the standard deviation of the stationary probability distribution function of the OU process. Indeed, we demonstrate consistency when there is a \(90 \%\) probability that the system without absorbing boundaries is found at a position less than \(\beta \); when reaching the boundary can no longer be considered a rare event. Therefore, our method can be easily extended to more general (less restrictive) settings. Finally, our compact analytical solution provides a computationally trivial framework for survival analysis of use across the broad spectrum of stochastic systems where the Ornstein–Uhlenbeck process arises.
References
Ricciardi, L.M., Sacerdote, L.: The Ornstein–Uhlenbeck process as a model for neuronal activity. Biol. Cybern. 35(1), 1–9 (1979)
O’Meara, B.C., Beaulieu, J.M.: Modelling stabilizing selection: the attraction of Ornstein–Uhlenbeck models. In: Garamszegi, L. (ed.) Modern Phylogenetic Comparative Methods and Their Application in Evolutionary Biology, pp. 381–393. Springer, Berlin (2014)
Trost, D.C., Overman, E.A., Ostroff, J.H., Xiong, W., March, P.: A model for liver homeostasis using modified mean-reverting Ornstein–Uhlenbeck process. Comput. Math. Methods Med. 11(1), 27–47 (2010)
Schöbel, R., Zhu, J.: Stochastic volatility with an Ornstein–Uhlenbeck process: an extension. Rev. Finance 3(1), 23–46 (1999)
Hasselmann, K.: Stochastic climate models Part I. Theory. Tellus 28(6), 473–485 (1976)
Moon, W., Wettlaufer, J.S.: A unified nonlinear stochastic time series analysis for climate science. Sci. Rep. 7, 44228 (2017)
Moon, W., Agarwal, S., Wettlaufer, J.S.: Intrinsic pink-noise multidecadal global climate dynamics mode. Phys. Rev. Lett. 121, 108701 (2018)
Pepe, F.V., Facchi, P., Kordi, Z., Pascazio, S.: Nonexponential decay of Feshbach molecules. Phys. Rev. A 101, 013632 (2020)
Maniscalco, S., Piilo, J., Suominen, K.-A.: Zeno and anti-Zeno effects for quantum brownian motion. Phys. Rev. Lett. 97, 130402 (2006)
Giacosa, F., Pagliara, G.: Measurement of the neutron lifetime and inverse quantum Zeno effect. Phys. Rev. D 101, 056003 (2020)
Zacks, S.: Introduction to Reliability Analysis: Probability Models and Statistical Methods. Springer, New York (2012)
McNeil, A.J., Frey, R., Embrechts, P.: Quantitative Risk Management: Concepts, Techniques and Tools-Eevised Edition. Princeton University Press, Princeton (2015)
Blossfeld, H., Hamerle, A., Mayer, K.U.: Event History Analysis: Statistical Theory and Application in the Social Sciences. Psychology Press, New York (2014)
Tuckwell, H.C.: Introduction to Theoretical Neurobiology (volume 2): Nonlinear and Stochastic Theories. Cambridge University Press, Cambridge (1988)
Mode, C.J., Sleeman, C.K.: Stochastic Processes in Epidemiology: HIV/AIDS, Other Infectious Diseases, and Computers. World Scientific, Singapore (2000)
Madec, Y., Japhet, C.: First passage time problem for drifted Ornstein–Uhlenbeck process. Math. Biosci. 189, 131–140 (2004)
Leblanc, B., Scaillet, O.: Path dependent options on yields in the affine term structure model. Finance Stoch. 2(4), 349–367 (1998)
Linetsky, V.: Computing hitting time densities for CIR and OU diffusions: applications to mean-reverting models. J. Comp. Finance 7, 1–22 (2004)
Jeanblanc, M., Rutkowski, M.: Modelling of default risk: an overview. In: Modern Mathematical Finance: Theory and Practice. Higher Ed. Press, Beijing (2000)
Majumdar, S.N., Pal, A., Schehr, G.: Extreme value statistics of correlated random variables: a pedagogical review. Phys. Rep. 840, 1 (2020)
Gautié, T., Le Doussal, P., Majumdar, S.N., Schehr, G.: Non-crossing Brownian paths and Dyson Brownian motion under a moving boundary. J. Stat. Phys. 177(5), 752–805 (2019)
Bray, A.J., Majumdar, S.N., Schehr, G.: Persistence and first-passage properties in nonequilibrium systems. Adv. Phys. 62, 225–361 (2013)
Redner, S.: A Guide to First-Passage Processes. Cambridge University Press, Cambridge (2001)
Alili, L., Patie, P., Pedersen, J.L.: Representations of the first hitting time density of an Ornstein–Uhlenbeck process. Stoch. Models 21(4), 967–980 (2005)
Martin, R.J., Kearney, M.J., Craster, R.V.: Long- and short-time asymptotics of the first-passage time of the Ornstein–Uhlenbeck and other mean-reverting processes. J. Phys. A: Math. Theor. 52, 134001 (2019)
Darling, D.A., Siegert, A.J.F.: The first passage problem for a continuous Markov process. Ann. Math. Stat. 24, 624–639 (1953)
Dolgoarshinnykh, R.G., Lalley, S.P.: Critical scaling for the SIS stochastic epidemic. J. App. Prob. 43(3), 892–898 (2006)
Ditlevsen, S., Lansky, P.: Estimation of the input parameters in the Ornstein–Uhlenbeck neuronal model. Phys. Rev. E 71(1), 011907 (2005)
We note that in the parlance of the field, the boundary layer is the inner region and the remainder of the domain is the outer region, although in this case the latter is in the interior of the potential
Bender, C.M., Orszag, S.A.: Advanced Mathematical Methods for Scientists and Engineers I: Asymptotic Methods and Perturbation Theory. Springer, New York (2013)
Moon, W., Balmforth, N.J., Wettlaufer, J.S.: Nonadiabatic escape and stochastic resonance. J. Phys. A: Math. Theor. 53, 095001 (2020)
Siegert, A.J.: On the first passage time probability problem. Phys. Rev. 81(4), 617 (1951)
Srinivasan, S.K., Sampath, G.: Stochastic Models for Spike Trains of Single Neurons, vol. 16. Springer, New York (2013)
Ricciardi, L.M.: Diffusion Processes and Related Topics in Biology, vol. 14. Springer, New York (2013)
Ricciardi, L.M., Sato, S.: First-passage-time density and moments of the Ornstein–Uhlenbeck process. J. App. Prob. 25(1), 43–57 (1988)
Nobile, A.G., Ricciardi, L.M., Sacerdote, L.: Exponential trends of Ornstein–Uhlenbeck first passage time densities. J. App. Prob. 22(2), 360–369 (1985)
Duffy, D.G.: Green’s Functions with Applications. Chapman and Hall/CRC, Boca Raton (2015)
Lansky, P., Ditlevsen, S.: A review of the methods for signal estimation in stochastic diffusion leaky integrate-and-fire neuronal models. Biol. Cybern. 99(4–5), 253 (2008)
Acknowledgements
We gratefully acknowledge support from the Swedish Research Council Grant No. 638-2013-9243.
Funding
Open access funding provided by Stockholm University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Gregory Schehr.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Giorgini, L.T., Moon, W. & Wettlaufer, J.S. Analytical Survival Analysis of the Ornstein–Uhlenbeck Process. J Stat Phys 181, 2404–2414 (2020). https://doi.org/10.1007/s10955-020-02669-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10955-020-02669-y