Abstract
Population dynamics with demographic variability is frequently studied using discrete random variables with continuous-time Markov chain (CTMC) models. An approximation of a CTMC model using continuous random variables can be derived in a straightforward manner by applying standard methods based on the reaction rates in the CTMC model. This leads to a system of Itô stochastic differential equations (SDEs) which generally have the form \( d \mathbf {y} = \varvec{\mu } \, dt + G \, d \mathbf {W},\) where \(\mathbf {y}\) is the population vector of random variables, \(\varvec{\mu }\) is the drift vector, and G is the diffusion matrix. In some problems, the derived SDE model may not have real-valued or nonnegative solutions for all time. For such problems, the SDE model may be declared infeasible. In this investigation, new systems of SDEs are derived with real-valued solutions and with nonnegative solutions. To derive real-valued SDE models, reaction rates are assumed to be nonnegative for all time with negative reaction rates assigned probability zero. This biologically realistic assumption leads to the derivation of real-valued SDE population models. However, small but negative values may still arise for a real-valued SDE model. This is due to the magnitudes of certain problem-dependent diffusion coefficients when population sizes are near zero. A slight modification of the diffusion coefficients when population sizes are near zero ensures that a real-valued SDE model has a nonnegative solution, yet maintains the integrity of the SDE model when sizes are not near zero. Several population dynamic problems are examined to illustrate the methodology.
Similar content being viewed by others
References
Allen EJ (2007) Modeling with Itô stochastic differential equations. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-5953-7
Allen LJS (2010) An introduction to stochastic processes with applications to biology, 2nd edn. CRC Press, Boca Raton. https://doi.org/10.1201/b12537
Allen LJS, Allen EJ (2003) A comparison of three different stochastic population models with regard to persistence time. Theor Popul Biol 68:439–449. https://doi.org/10.1016/S0040-5809(03)00104-7
Allen LJS, Lahodny GE Jr (2012) Extinction thresholds in deterministic and stochastic epidemic models. J Biol Dyn 6:590–611. https://doi.org/10.1080/17513758.2012.665502
Allen EJ, Allen LJS, Arciniega A, Greenwood P (2008) Construction of equivalent stochastic differential equation models. Stoch Anal Appl 26:274–297. https://doi.org/10.1080/07362990701857129
Anderson RM, Anderson B, May RM (1992) Infectious diseases of humans: dynamics and control. Oxford University Press, Oxford
Andersson H, Britton T (2012) Stochastic epidemic models and their statistical analysis. Springer, New York. https://doi.org/10.1007/978-1-4612-1158-7
Bailey NTJ (1964) The elements of stochastic processes with applications to the natural sciences. Wiley, New York
Brauer F (2008) Compartmental models in epidemiology. In: Brauer F, van den Driessche P, Wu J (eds) Mathematical epidemiology. Springer, Berlin, pp 19–79. https://doi.org/10.1007/978-3-540-78911-6
Cresson J, Sonner S (2018) A note on a derivation method for SDE models: applications in biology and viability criteria. Stoch Anal Appl 36:224–239. https://doi.org/10.1080/07362994.2017.1386571
Daley DJ, Gani J (2001) Epidemic modelling: an introduction. Cambridge University Press, Cambridge. https://doi.org/10.1017/CBO9780511608834
Dana S, Raha S (2011) Physically consistent simulation of mesoscale chemical kinetics: the non-negative FIS-\(\alpha \) method. J Comput Phys 230:8813–8834. https://doi.org/10.1016/j.jcp.2011.07.032
Doytchinov B, Irby R (2010) Time discretization of Markov chains. Pi Mu Epsilon J 13:69–82
Edelstein-Keshet L (2005) Mathematical models in biology. SIAM, Philadelphia. https://doi.org/10.1137/1.9780898719147
Engen S, Sæther B-E (1998) Stochastic population models: some concepts, definitions and results. Oikos 83:345–352. https://doi.org/10.2307/3546848
Gard T (1987) Introduction to stochastic differential equations. Marcel Decker, New York. https://doi.org/10.2307/2347318
Gillespie D (1977) Exact stochastic simulation of coupled chemical reactions. J Phys Chem 81:2340–2361. https://doi.org/10.1021/j100540a008
Gillespie DT (2000) The chemical Langevin equation. J Chem Phys 113:297–306. https://doi.org/10.1063/1.481811
Gyöngy I, Rásonyi M (2011) A note on Euler approximations for SDEs with Hölder continuous diffusion coefficients. Stoch Proc Appl 121:2189–2200. https://doi.org/10.1016/j.spa.2011.06.008
Jentzen A, Kloeden PE, Neuenkirch A (2009) Pathwise approximations of stochastic differential equations on domains: higher order convergence rates without global Lipschitz coefficients. Numer Math 112:41–64. https://doi.org/10.1007/s00211-008-0200-8
Kloeden PE, Pötzsche C (2010) Dynamics of modified predator–prey models. Int J Bifurc Chaos 20:2657–2669. https://doi.org/10.1142/S0218127410027271
Kloeden PE, Platen E, Schurz H (1994) Numerical solution of SDE through computer experiments. Springer, Berlin. https://doi.org/10.1007/978-3-642-57913-4
Kurtz TG (1970) Solutions of ordinary differential equations as limits of pure jump Markov processes. J Appl Probab 7:49–58. https://doi.org/10.2307/3212147
Kurtz T (1971) Limit theorems for sequences of jump Markov processes approximating ordinary differential equations. J Appl Probab 8:344–356. https://doi.org/10.2307/3211904
Lande R, Engen S, Saethe B-E (2003) Stochastic population dynamics in ecology and conservation. Oxford University Press, Oxford. https://doi.org/10.1093/acprof:oso/9780198525257.001.0001
Langevin P (1908) Sur la théorie du mouvement brownien. C R Acad Sci 146:530–533. https://doi.org/10.1119/1.18725
Matis JH, Kiffe TR (2000) Stochastic population models: a compartmental perspective. Springer, New York. https://doi.org/10.1007/978-1-4612-1244-7
Niu Y, Burrage K, Chen L (2016) Modelling biochemical reaction systems by stochastic differential equations with reflection. J Theor Biol 396:90–104. https://doi.org/10.1016/j.jtbi.2016.02.010
Schnoerr D, Sanguinetti G, Grima R (2014) The complex chemical Langevin equation. J Chem Phys 141:024103. https://doi.org/10.1063/1.4885345
Schnoerr D, Sanguinetti G, Grima R (2017) Approximation and inference methods for stochastic biochemical kinetics—a tutorial review. J Phys A 50:093001. https://doi.org/10.1088/1751-8121/aa54d9
Schwartz IB, Smith HL (1983) Infinite subharmonic bifurcation in an SEIR epidemic model. J Math Biol 18:233–253. https://doi.org/10.1007/BF00276090
Taylor HM, Karlin S (1998) An introduction to stochastic modeling, 3rd edn. Academic Press, San Diego
Whittle P (1955) The outcome of a stochastic epidemic-a note on Bailey’s paper. Biometrika 42:116–122. https://doi.org/10.1093/biomet/42.1-2.116
Wilkie J, Wong Y (2008) Positivity preserving chemical Langevin equations. Chem Phys 353:132–138. https://doi.org/10.1016/jchemphys200808001
Wilkinson DJ (2011) Stochastic modelling for systems biology, 2nd edn. CRC Press, Boca Raton. https://doi.org/10.1201/b11812
Yamada T, Watanabe S (1971) On the uniqueness of solutions of stochastic differential equations. J Math Kyoto Univ 11:155–167. https://doi.org/10.1215/kjm/1250523691
Yang H, Kloeden PE, Wu F (2019) Existence and approximation of strong solutions of stochastic differential equations with fractional diffusion coefficient. Discrete Contin Dyn B 24:5553–5567. https://doi.org/10.3934/dcdsb.2019071
Acknowledgements
The authors are grateful to the two anonymous referees and to the editors Y. Lou and M. Gyllenberg for their helpful and thoughtful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1: a nonnegative SDE model with smooth diffusion coefficients
The nonnegative SDE model described in Sect. 2 does not have Lipschitz continuous diffusion coefficients at zero. A nonnegative model with smooth diffusion coefficients is described in this appendix where the reaction rates are modified slightly differently than in the nonnegative SDE model of Sect. 2. To describe the model, the changes \(\lambda _{k,i}\) are considered for \(i=1,\ldots , N\) for each reaction rate \(k= 1,2, \ldots , M\). Given small \(\delta >0\), recall that
Then, for this new SDE model, the kth rate is modified as
where \(\phi _i^{\delta } (\mathbf {y}(t))\) is defined in Eq. (10). In particular, if \(y_i(t) \ge \delta \) for all \( i \in L_k\), then \({{\hat{r}}}_k^{\delta }(t, \mathbf {y}(t)) = {\hat{r}}_k(t, \mathbf {y}(t)).\) Similar to the earlier nonnegative SDE, the modified diffusion coefficients are given by
for \(k=1, \ldots , M\). Furthermore, the conservation property of Proposition 1 holds for both nonnegative SDE models and, computationally, the two nonnegative SDE models give similar results. For example, in the Michaelis–Menten worst-case scenario exit-time problem (described in Sect. 3.5) with \(K=4\), \(y_1(0)=5\), and \(\delta = 0.1\), the calculated exit times for the real-valued SDE, the nonnegative-valued SDE, the complex CLE method, and the CTMC models give, respectively, mean values of 2.80, 2.92, 2.90, 3.17 and standard deviations of 0.72, 0.77, 0.80, 0.84 for 5000 sample paths. The nonnegative-valued SDE model described in this appendix gives a mean exit time of 3.14 with a standard deviation of 0.85 which compares well with the other models.
Appendix 2: additional Michaelis–Menten computations for \(K=4\)
Continuing the example from Sect. 3.5, means and standard deviations are compared for the substrate and enzyme molecules using the real-valued and nonnegative-valued SDE models and CLE method for \(K=4\). The number of substrate molecules, \(y_1(t)\), and the number of free enzyme molecules, \(y_2(t)\), are calculated when \(y_1(0)=1\), \(y_2(0)= 3\), \(y_3(0)=0\), \(k_2=1\), \(k_3=1\), \(k_4=5\), \(K=4\) up to time \(t=5\). The Euler–Maruyama method is used to approximate the real-valued and nonnegative-valued SDEs with a time step of 0.0005, 1000 sample paths, and \(\delta =0.1\). The computational results for average population sizes and standard deviations are displayed in Fig. 9 along with the results of the complex CLE method. The CLE method and the results of the real-valued and nonnegative-valued SDE models generally agree well with the CTMC model for the substrate molecules, but there is disagreement with the CTMC model for free enzyme molecules when the mean is less than two. In particular, the calculated standard deviations for the real-valued and nonnegative-valued SDE models differ from CTMC model by as much as 20% with a closer agreement between the complex CLE method and the CTMC model (\(\approx 10\%)\).
Rights and permissions
About this article
Cite this article
Allen, E.J., Allen, L.J.S. & Smith, H.L. On real-valued SDE and nonnegative-valued SDE population models with demographic variability. J. Math. Biol. 81, 487–515 (2020). https://doi.org/10.1007/s00285-020-01516-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00285-020-01516-8