Abstract
We consider three classical models of biological evolution: (i) the Moran process, an example of a reducible Markov Chain; (ii) the Kimura Equation, a particular case of a degenerated Fokker-Planck Diffusion; (iii) the Replicator Equation, a paradigm in Evolutionary Game Theory. While these approaches are not completely equivalent, they are intimately connected, since (ii) is the diffusion approximation of (i), and (iii) is obtained from (ii) in an appropriate limit. It is well known that the Replicator Dynamics for two strategies is a gradient flow with respect to the celebrated Shahshahani distance. We reformulate the Moran process and the Kimura Equation as gradient flows and in the sequel we discuss conditions such that the associated gradient structures converge: (i) to (ii), and (ii) to (iii). This provides a geometric characterisation of these evolutionary processes and provides a reformulation of the above examples as time minimisation of free energy functionals.
Similar content being viewed by others
References
Akin, E.: The Geometry of Population Genetics. Lecture Notes in Biomathematics, vol. 31. Springer, Berlin (1979)
Akin, E.: The differential geometry of population genetics and evolutionary games. In: Lessard, S. (ed.) Mathematical and Statistical Developments of Evolutionary Theory. Proc. Semin., Montréal, Canada, 1987. NATO ASI Ser., Ser. C, vol. 299, pp. 1–93. Kluwer Academic, Dordrecht (1990)
Ambrosio, L., Gigli, N.: A user’s guide to optimal transport. In: Modelling and Optimisation of Flows on Networks, Cetraro, Italy, 2009 Lecture Notes in Mathematics, vol. 2062, pp. 1–155. Springer, Berlin (2013)
Ambrosio, L., Fusco, N., Pallara, D.: Functions of Bounded Variation and Free Discontinuity Problems. Clarendon, Oxford (2000)
Ambrosio, L., Gigli, N., Savaré, G.: Gradient Flows in Metric Spaces and in the Space of Probability Measures, 2nd edn. Birkhäuser, Basel (2008)
Antonelli, P.L., Strobeck, C.: The geometry of random drift I. Stochastic distance and diffusion. Adv. Appl. Probab. 9(2), 238–249 (1977)
Athreya, K.B., Ney, P.E.: Branching Processes, vol. 196. Springer, Berlin (1972)
Behera, N.: Variational principles in evolution. Bull. Math. Biol. 58(1), 175–202 (1996)
Bellomo, N., Delitala, M.: From the mathematical kinetic, and stochastic game theory to modelling mutations, onset, progression and immune competition of cancer cells. Phys. Life Rev. 5(4), 183–206 (2008)
Benamou, J.-D., Brenier, Y.: A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer. Math. 84(3), 375–393 (2000)
Blanchet, A., Laurencot, P.: The parabolic-parabolic Keller-Segel system with critical diffusion as a gradient flow in \(\mathbb{R}^{d}\), \(d\ge 3\). Commun. Partial Differ. Equ. 38(4), 658–686 (2013)
Bürger, R.: The Mathematical Theory of Selection, Recombination, and Mutation. Wiley, Chichester (2000)
Carlier, G., Duval, V., Peyré, G., Schmitzer, B.: Convergence of entropic schemes for optimal transport and gradient flows. SIAM J. Math. Anal. 49(2), 1385–1418 (2017)
Cattiaux, P., Méléard, S.: Competitive or weak cooperative stochastic Lotka–Volterra systems conditioned on non-extinction. J. Math. Biol. 60(6), 797–829 (2010)
Cattiaux, P., Collet, P., Lambert, A., Martínez, S., Méléard, S., San Martín, J., et al.: Quasi-stationary distributions and diffusion models in population dynamics. Ann. Appl. Probab. 37(5), 1926–1969 (2009)
Cavalli-Sforza, L.L., Bodmer, W.F.: The Genetics of Human Populations. Freeman, New York (1971)
Chalub, F.A.C.C., Souza, M.O.: From discrete to continuous evolution models: a unifying approach to drift-diffusion and replicator dynamics. Theor. Popul. Biol. 76(4), 268–277 (2009)
Chalub, F.A.C.C., Souza, M.O.: A non-standard evolution problem arising in population genetics. Commun. Math. Sci. 7(2), 489–502 (2009)
Chalub, F.A.C.C., Souza, M.O.: The frequency-dependent Wright-Fisher model: diffusive and non-diffusive approximations. J. Math. Biol. 68(5), 1089–1133 (2014)
Chalub, F.A.C.C., Souza, M.O.: Fixation in large populations: a continuous view of a discrete problem. J. Math. Biol. 72(1–2), 283–330 (2016)
Chalub, F.A.C.C., Souza, M.O.: On the stochastic evolution of finite populations. J. Math. Biol. 75(6–7), 1735–1774 (2017)
Chalub, F.A.C.C., Souza, M.O.: Fitness potentials and qualitative properties of the Wright-Fisher dynamics. J. Theor. Biol. 457, 57–65 (2018)
Champagnat, N., Villemonais, D.: Exponential convergence to quasi-stationary distribution and \(Q\)-process. Probab. Theory Relat. 164(1–2), 243–283 (2016)
Champagnat, N., Ferrière, R., Méléard, S.: Unifying evolutionary dynamics: from individual stochastic processes to macroscopic models. Theor. Popul. Biol. 69(3), 297–321 (2006)
Chow, S.-N., Huang, W., Li, Y., Zhou, H.: Fokker–Planck equations for a free energy functional or Markov process on a graph. Arch. Ration. Mech. Anal. 203(3), 969–1008 (2012)
Chui, C.K.: Concerning rates of convergence of Riemann sums. J. Approx. Theory 4(3), 279–287 (1971)
Collet, P., Martínez, S., Martín, J.S.: Quasi-Stationary Distributions. Springer, Berlin (2013)
Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, USA, vol. 2, NIPS’13, pp. 2292–2300 (2013). Curran Associates Inc.
Dal Maso, G.: An Introduction to \(\varGamma \)-Convergence, vol. 8. Birkhäuser, Basel (1993)
Danilkina, O., Souza, M.O., Chalub, F.A.C.C.: Conservative parabolic problems: nondegenerated theory and degenerated examples from population dynamics. Math. Methods Appl. Sci. 41(12), 4391–4406 (2018)
De Giorgi, E.: New problems on minimizing movements. In: Boundary Value Problems for Partial Differential Equations and Applications. Dedicated to Enrico Magenes on the Occasion of his 70th Birthday, pp. 81–98. Masson, Paris (1993)
De Giorgi, E., Marino, A., Tosques, M.: Problems of evolution in metric spaces and maximal decreasing curve. Atti Accad. Naz. Lincei, Cl. Sci. Fis. Mat. Nat., Rend. Lincei 8(68), 180–187 (1980)
DeAngelis, D.L., Mooij, W.M.: Individual-based modeling of ecological and evolutionary processes. Annu. Rev. Ecol. Evol. Syst. 36, 147–168 (2005)
Dembo, A., Zeitouni, O.: Large Deviations Techniques and Applications, vol. 38, 2nd edn. Springer, Berlin (2010), corrected 2nd printing edition
Di Francesco, M., Fagioli, S.: Measure solutions for non-local interaction PDEs with two species. Nonlinearity 26(10), 2777–2808 (2013)
Disser, K., Liero, M.: On gradient structures for Markov chains and the passage to Wasserstein gradient flows. Netw. Heterog. Media 10(2), 233–253 (2015)
Edwards, A.W.F.: Likelihood. Cambridge University Press, Cambridge (1972)
Erbar, M., Fathi, M., Laschos, V., Schlichting, A.: Gradient flow structure for McKean-Vlaslov equations on discrete spaces. Discrete Contin. Dyn. Syst. 3612, 6799–6833 (2016)
Etheridge, A.: Some Mathematical Models from Population Genetics: École D’Été de Probabilités de Saint-Flour XXXIX-2009, vol. 2012. Springer, Berlin (2011)
Ethier, S.N., Kurtz, T.G.: Markov Processes. Characterization and Convergence. Wiley, Hoboken (1986)
Ewens, W.: An optimizing principle of natural selection in evolutionary population genetics. Theor. Popul. Biol. 42(3), 333–346 (1992)
Ewens, W.J.: Mathematical Population Genetics. I: Theoretical Introduction, 2nd edn. Springer, New York (2004)
Ewens, W.J.: What is the gene trying to do? Br. J. Philos. Sci. 62(1), 155–176 (2011)
Ewens, W.J., Lessard, S.: On the interpretation and relevance of the fundamental theorem of natural selection. Theor. Popul. Biol. 104, 59–67 (2015)
Figalli, A., Gigli, N.: A new transportation distance between non-negative measures with applications to gradient flows with Dirichlet boundary conditions. J. Math. Pures Appl. 94(2), 107–130 (2010)
Fisher, R.A.: On the dominance ratio. Proc. R. Soc. Edinb. 42, 321–341 (1922)
Fisher, R.A.: The Genetical Theory of Natural Selection. Clarendon, Oxford (1930)
Furuichi, S., Yanagi, K., Kuriyama, K.: Fundamental properties of Tsallis relative entropy. J. Math. Phys. 45(12), 4868–4877 (2004)
Gigli, N., Maas, J.: Gromov–Hausdorff convergence of discrete transportation metrics. SIAM J. Math. Anal. 45(2), 879–899 (2013)
Gladbach, P., Kopfer, E., Maas, J.: Scaling limits of discrete optimal transport, arXiv preprint (2018). arXiv:1809.01092
Gladbach, P., Kopfer, E., Maas, J., Portinale, L.: Homogenisation of one-dimensional discrete optimal transport, arXiv preprint (2019). arXiv:1905.05757
Grafen, W.J.E.: The Price equations, fitness maximization, optimisation and the fundamental theorem of natural selection. Biol. Philos. 29(2), 197–205 (2014)
Gyllenberg, M., Parvinen, K.: Necessary and sufficient conditions for evolutionary suicide. Bull. Math. Biol. 63(5), 981–993 (2001)
Gyllenberg, M., Service, R.: Necessary and sufficient conditions for the existence of an optimisation principle in evolution. J. Math. Biol. 62(3), 359–369 (2011)
Gyllenberg, M., et al.: Necessary and sufficient conditions for the existence of an optimisation principle in evolution. J. Math. Biol. 62(3), 359–369 (2011)
Gyllenberg, M., Metz, J.A.J.H., Service, R.: When do optimisation arguments make evolutionary sense? In: Chalub, F.A.C.C., Rodrigues, J.F. (eds.) The Mathematics of Darwin’s Legacy, Mathematics and Biosciences in Interaction, pp. 233–268. Birkhäuser, Basel (2011)
Harper, M.: Escort evolutionary game theory. Physica D 240(18), 1411–1415 (2011)
Hauert, C., Doebeli, M.: Spatial structure often inhibits the evolution of cooperation in the snowdrift game. Nature 428(6983), 643 (2004)
Hofbauer, J.: The selection mutation equation. J. Math. Biol. 23(1), 41–53 (1985)
Hofbauer, J., Sigmund, K.: Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge (1998)
Hofbauer, J., Sigmund, K.: Evolutionary game dynamics. Bull. Am. Math. Soc. 40(4), 479–519 (2003)
Hofrichter, J., Jost, J., Tran, T.D.: Information geometry and population genetics. The mathematical structure of the Wright-Fisher model. Springer, Cham (2017)
Horn, R.A., Johnson, C.R.: Matrix Analysis, 2nd edn. Cambridge University Press, Cambridge (2013)
Jones, W.: Variational principles for entropy production and predictive statistical mechanics. J. Phys. A, Math. Gen. 16(15), 3629 (1983)
Jordan, R., Kinderlehrer, D., Otto, F.: The variational formulation of the Fokker-Planck equation. SIAM J. Math. Anal. 29(1), 1–17 (1998)
Karev, G.P., Koonin, E.V.: Parabolic replicator dynamics and the principle of minimum Tsallis information gain. Biol. Direct 8, 19 (2013)
Karlin, S., Taylor, H.E.: A Second Course in Stochastic Processes. Elsevier, Amsterdam (1981)
Kelly, F.P.: Reversibility and Stochastic Networks. Cambridge University Press, Cambridge (2011)
Kimura, M.: On the change of population fitness by natural selection. Heredity 12, 145–167 (1958)
Kimura, M.: On the probability of fixation of mutant genes in a population. Genetics 47, 713–719 (1962)
Kinderlehrer, D., Monsaingeon, L., Xu, X.: A Wasserstein gradient flow approach to Poisson-Nernst-Planck equations. ESAIM Control Optim. Calc. Var. 23(1), 137–164 (2017)
Kisdi, É.: Frequency dependence versus optimization. Trends Ecol. Evol. 13(12), 508 (1998)
Laguzet, L.: High order variational numerical schemes with application to Nash-MFG vaccination games. Ric. Mat. 67(1, SI), 247–269 (2018)
Lamperti, J., Ney, P.: Conditioned branching processes and their limiting diffusions. Theory Probab. Appl. 13(1), 128–139 (1968)
Laurençot, P., Matioc, B.-V.: A gradient flow approach to a thin film approximation of the Muskat problem. Calc. Var. Partial Differ. Equ. 47(1–2), 319–341 (2013)
Léonard, C.: From the Schrödinger problem to the Monge–Kantorovich problem. J. Funct. Anal. 262(4), 1879–1920 (2012)
Lisini, S.: Nonlinear diffusion equations with variable coefficients as gradient flows in Wasserstein spaces. ESAIM Control Optim. Calc. Var. 15(3), 712–740 (2009)
Maas, J.: Gradient flows of the entropy for finite Markov chains. J. Funct. Anal. 261(8), 2250–2292 (2011)
Manturov, O.V.: The product integral. J. Sov. Math. 55(5), 2042–2076 (1991)
Mariani, M.: A \(\varGamma \)-convergence approach to large deviations. Ann. Sc. Norm. Super. Pisa, Cl. Sci. (5) 18(3), 951–976 (2018)
Martyushev, L.M., Seleznev, V.D.: Maximum entropy production principle in physics, chemistry and biology. Phys. Rep. 426(1), 1–45 (2006)
Meszena, G., Kisdi, É., Dieckmann, U., Geritz, S.A., Metz, J.A.: Evolutionary optimisation models and matrix games in the unified perspective of adaptive dynamics. Selection 2(1–2), 193–220 (2002)
Metz, J.A.J., Mylius, S.D., Diekmann, O.: When does evolution optimize? On the relation between types of density dependence and evolutionarily stable life history parameters. In: IIASA Working Paper WP-96-004, IIASA, Laxenburg, Austria (1996)
Metz, J., Mylius, S., Diekmann, O.: When does evolution optimize? Evol. Ecol. Res. 10, 629–654 (2008)
Mielke, A.: Geodesic convexity of the relative entropy in reversible Markov chains. Calc. Var. Partial Differ. Equ. 48(1–2), 1–31 (2013)
Mielke, A.: On evolutionary \(\varGamma \)-convergence for gradient systems. In: Macroscopic and Large Scale Phenomena: Coarse Graining, Mean Field Limits and Ergodicity, pp. 187–249. Springer, Berlin (2016)
Mielke, A., Montefusco, A., Peletier, M.A.: Exploring families of energy-dissipation landscapes via tilting–three types of EDP convergence, arXiv preprint (2020). arXiv:2001.01455
Moran, P.: The Statistical Processes of Evolutionary Theory. Clarendon, Oxford (1962)
Mylius, S.D., Metz, J.A.J.: When does evolution optimize? On the relationship between evolutionary stability, optimization and density dependence. In: Elements of Adaptive Dynamics. Cambridge University Press, Cambridge (2004)
Norris, J.R.: Markov Chains. Reprint, vol. 2. Cambridge University Press, Cambridge (1998), reprint edition
Otto, F.: The geometry of dissipative evolution equations: the porous medium equation. Commun. Partial Differ. Equ. 26(1–2), 101–174 (2001)
Reda, F.A., Maury, B.: Interpretation of finite volume discretization schemes for the Fokker-Planck equation as gradient flows for the discrete Wasserstein distance. In: Topological Optimization and Optimal Transport in the Applied Sciences, pp. 400–416. de Gruyter, Berlin (2017)
Sandier, E., Serfaty, S.: Gamma-convergence of gradient flows with applications to Ginzburg-Landau. Commun. Pure Appl. Anal. 57(12), 1627–1672 (2004)
Santambrogio, F.: Optimal Transport for Applied Mathematicians. Calculus of Variations, PDEs, and Modeling, vol. 87. Springer, Berlin (2015)
Santambrogio, F.: {Euclidean, metric, and Wasserstein} gradient flows: an overview. Bull. Math. Sci. 7(1), 87–154 (2017)
Schuster, P., Sigmund, K.: Replicator dynamics. J. Theor. Biol. 100(3), 533–538 (1983)
Serfaty, S.: Gamma-convergence of gradient flows on Hilbert and metric spaces and applications. Discrete Contin. Dyn. Syst. 31(4), 1427–1451 (2011)
Shahshahani, S.: A new mathematical framework for the study of linkage and selection. Mem. Am. Math. Soc. 211, 34 (1979)
Sigmund, K.: Game dynamics, mixed strategies, and gradient systems. Theor. Popul. Biol. 32(1), 114–126 (1987)
Sigmund, K.: A maximum principle for frequency dependent selection. Math. Biosci. 84(2), 189–195 (1987)
Sigmund, K., Nowak, M.A.: Evolutionary game theory. Curr. Biol. 9(14), R503–R505 (1999)
Smith, J.M.: Optimization theory in evolution. Annu. Rev. Ecol. Syst. 9(1), 31–56 (1978)
Sober, E., Steel, M.: Entropy increase and information loss in Markov models of evolution. Biol. Philos. 26(2), 223–250 (2011)
Stoer, J., Bulirsch, R.: Introduction to Numerical Analysis. Text in Applied Mathematics, vol. 12. Springer, New York (2002)
Taylor, P.D., Jonker, L.B.: Evolutionarily stable strategies and game dynamics. Math. Biosci. 40(1–2), 145–156 (1978)
Veloz, T., Razeto-Barry, P., Dittrich, P., Fajardo, A.: Reaction networks and evolutionary game theory. J. Math. Biol. 68(1–2), 181–206 (2014)
Villani, C.: Topics in Optimal Transportation, vol. 58. Am. Math. Soc. Providence (2003)
Villani, C.: Optimal Transport. Old and New, vol. 338. Springer, Berlin (2009)
Weibull, J.W.: Evolutionary Game Theory. MIT Press, Cambridge (1997)
Wright, S.: Evolution in Mendelian populations. Genetics 16(2), 0097 (1931)
Xuan, L.V., Lan, N.T., Viet, N.A.: On application of non-extensive statistical mechanics to studying ecological diversity. J. Phys. Conf. Ser. 726, 012024 (2016)
Zettl, A.: Sturm-Liouville Theory. Am. Math. Soc., Providence (2005)
Ziman, J.: The general variational principle of transport theory. Can. J. Phys. 34(12A), 1256–1273 (1956)
Acknowledgements
FACCC and AMR were partially supported by FCT/Portugal Strategic Project UID/MAT/00297/2019 (Centro de Matemática e Aplicações, Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa). FACCC also benefited from an “Investigador FCT” grant. LM was supported by FCT/Portugal projects PTDC/MAT-STA/0975/2014 and PTDC/MAT-STA/28812/2017. MOS was partially supported by CNPq under grants # 309079/2015-2, 310293/2018-9 and by CAPES — Finance Code 001. We also thank an anonymous reviewer for many comments that helped us to improve the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chalub, F.A.C.C., Monsaingeon, L., Ribeiro, A.M. et al. Gradient Flow Formulations of Discrete and Continuous Evolutionary Models: A Unifying Perspective. Acta Appl Math 171, 24 (2021). https://doi.org/10.1007/s10440-021-00391-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10440-021-00391-9
Keywords
- Gradient flow structure
- Optimal transport
- Replicator dynamics
- Shahshahani distance
- Reducible Markov chains
- Kimura equation