Abstract
In this paper, the performance appropriateness of population-based metaheuristics for immunotherapy protocols is investigated on a comparative basis while the goal is to stimulate the immune system to defend against cancer. For this purpose, genetic algorithm and particle swarm optimization are employed and compared with modern method of Pontryagin’s minimum principle (PMP). To this end, a well-known mathematical model of cell-based cancer immunotherapy is described and examined to formulate the optimal control problem in which the objective is the annihilation of tumour cells by using the minimum amount of cultured immune cells. In this regard, the main aims are: (i) to introduce a single-objective optimization problem and to design the considered metaheuristics in order to appropriately deal with it; (ii) to use the PMP in order to obtain the necessary conditions for optimality, i.e. the governing boundary value problem; (iii) to measure the results obtained by using the proposed metaheuristics against those results obtained by using an indirect approach called forward-backward sweep method; and finally (iv) to produce a set of optimal treatment strategies by formulating the problem in a bi-objective form and demonstrating its advantages over single-objective optimization problem. A set of obtained results conforms the performance capabilities of the considered metaheuristics.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Altrock PM, Liu LL, Michor F (2015) The mathematics of cancer: integrating quantitative models. Nat Rev Cancer 15(12):730. https://doi.org/10.1038/nrc4029
Arabameri A, Asemani D, Hadjati J (2018) A structural methodology for modeling immune-tumor interactions including pro- and anti-tumor factors for clinical applications. Math Biosci 304:48–61. https://doi.org/10.1016/j.mbs.2018.07.006
Banerjee S, Sarkar RR (2008) Delay-induced model for tumor–immune interaction and control of malignant tumor growth. Biosystems 91(1):268–288. https://doi.org/10.1016/j.biosystems.2007.10.002
Batmani Y, Khaloozadeh H (2013) Optimal drug regimens in cancer chemotherapy: a multi-objective approach. Comput Biol Med 43(12):2089–2095. https://doi.org/10.1016/j.compbiomed.2013.09.026
Bellman RE, Kalaba R (1966) Dynamic programming and modern control theory. Academic Press, New York
Betts JT (1998) Survey of numerical methods for trajectory optimization. J Guid Control Dyn 21(2):193–207
Bonyadi MR, Michalewicz Z (2017) Particle swarm optimization for single objective continuous space problems: a review. Evol Comput 25(1):1–54. https://doi.org/10.1162/EVCO_r_00180
Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 68(6):394–424. https://doi.org/10.3322/caac.21492
Browne CB, Powley E, Whitehouse D, Lucas SM, Cowling PI, Rohlfshagen P, Tavener S, Perez D, Samothrakis S, Colton S (2012) A survey of Monte Carlo tree search methods. IEEE Trans Comput Intell AI Games 4(1):1–43. https://doi.org/10.1109/TCIAIG.2012.2186810
Burden T, Ernstberger J, Fister KR (2004) Optimal control applied to immunotherapy. Discrete Control Dyn B 4(1):135–146. https://doi.org/10.3934/dcdsb.2004.4.135
Cappuccio A, Elishmereni M, Agur Z (2006) Cancer immunotherapy by interleukin-21: potential treatment strategies evaluated in a mathematical model. Cancer Res 66(14):7293–7300. https://doi.org/10.1158/0008-5472.CAN-06-0241
Cappuccio A, Castiglione F, Piccoli B (2007) Determination of the optimal therapeutic protocols in cancer immunotherapy. Math Biosci 209(1):1–13. https://doi.org/10.1016/j.mbs.2007.02.009
Castiglione F, Piccoli B (2006) Optimal control in a model of dendritic cell transfection cancer immunotherapy. Bull Math Biol 68(2):255–274. https://doi.org/10.1007/s11538-005-9014-3
Castiglione F, Piccoli B (2007) Cancer immunotherapy, mathematical modeling and optimal control. J Theor Biol 247(4):72–732. https://doi.org/10.1016/j.jtbi.2007.04.003
Celada F, Seiden PE (1992) A computer model of cellular interactions in the immune system. Immunol Today 13(2):56–62. https://doi.org/10.1016/0167-5699(92)90135-T
Clerc M, Kennedy J (2002) The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73. https://doi.org/10.1109/4235.985692
Coello CAC, Lamont GB, van Veldhuizen DA (2007) Evolutionary algorithms for solving multi-objective problems, 2nd edn. Springer, New York. https://doi.org/10.1007/978-0-387-36797-2
Deb K (2014) Multi-objective optimization. In: Search methodologies: introductory tutorials in optimization and decision support techniques, 2nd edn. Springer, Boston, pp 403–449. https://doi.org/10.1007/978-1-4614-6940-7_15
Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2):182–197. https://doi.org/10.1109/4235.996017
d’Onofrio A (2008) Metamodeling tumor–immune system interaction, tumor evasion and immunotherapy. Math Comput Model 47(5–6):614–637. https://doi.org/10.1016/j.mcm.2007.02.032
Eberhart RC, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of the 2000 congress on evolutionary computation, vol 1. IEEE, pp 84–88. https://doi.org/10.1109/CEC.2000.870279
Eftimie R, Bramson JL, Earn DJD (2011) Interactions between the immune system and cancer: a brief review of non-spatial mathematical models. Bull Math Biol 73(1):2–32. https://doi.org/10.1007/s11538-010-9526-3
Elmouki I, Saadi S (2016) BCG immunotherapy optimization on an isoperimetric optimal control problem for the treatment of superficial bladder cancer. Int J Dyn Control 4(3):339–345. https://doi.org/10.1007/s40435-014-0106-5
Evans ER, Bugga P, Asthana V, Drezek R (2018) Metallic nanoparticles for cancer immunotherapy. Mater Today 21(6):673–685. https://doi.org/10.1016/j.mattod.2017.11.022
Ghaffari A, Naserifar N (2010) Optimal therapeutic protocols in cancer immunotherapy. Comput Biol Med 40(3):261–270. https://doi.org/10.1016/j.compbiomed.2009.12.001
Goldberg DE (1989) Genetic algorithms in search, optimization and machine learning, 1st edn. Addison-Wesley Publishing Company, Inc., Boston
Gopalakrishnan V, Helmink BA, Spencer CN, Reuben A, Wargo JA (2018) The influence of the gut microbiome on cancer, immunity, and cancer immunotherapy. Cancer Cell 33(4):570–580. https://doi.org/10.1016/j.ccell.2018.03.015
Holland JH (1975) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press, Ann Arbor
Houy N, Grand GL (2019) Optimizing immune cell therapies with artificial intelligence. J Theor Biol 461:34–40. https://doi.org/10.1016/j.jtbi.2018.09.007
Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of ICNN’95-International Conference on Neural Networks, vol 4. IEEE, pp 1942–1948. https://doi.org/10.1109/ICNN.1995.488968
Khalil DN, Budhu S, Gasmi B, Zappasodi R, Hirschhorn-Cymerman D, Plitt T, Henau OD, Zamarin D, Holmgaard RB, Murphy JT, Wolchok JD, Merghoub T (2015) Chapter one—the new era of cancer immunotherapy: manipulating t-cell activity to overcome malignancy. In: Immunotherapy of cancer, advances in cancer research, vol 128. Elsevier Inc. Academic Press, pp 1–68. https://doi.org/10.1016/bs.acr.2015.04.010
Kiran KL, Lakshminarayanan S (2013) Optimization of chemotherapy and immunotherapy: in silico analysis using pharmacokinetic–pharmacodynamic and tumor growth models. J Process Control 23(3):396–403. https://doi.org/10.1016/j.jprocont.2012.12.006
Kirschner D, Panetta JC (1998) Modeling immunotherapy of the tumor–immune interaction. J Math Biol 37(3):235–252. https://doi.org/10.1007/s002850050127
Kosinsky Y, Dovedi SJ, Peskov K, Voronova V, Chu L, Tomkinson H, Al-Huniti N, Stanski DR, Helmlinger G (2018) Radiation and PD-(L)1 treatment combinations: immune response and dose optimization via a predictive systems model. J Immunother Cancer 16(1):17. https://doi.org/10.1186/s40425-018-0327-9
Kuznetsov VA, Makalkin IA, Taylor MA, Perelson AS (1994) Nonlinear dynamics of immunogenic tumors: parameter estimation and global bifurcation analysis. Bull Math Biol 56(2):295–321. https://doi.org/10.1007/BF02460644
Ledzewicz U, Mosalman MSF, Schättler H (2013) Optimal controls for a mathematical model of tumor–immune interactions under targeted chemotherapy with immune boost. Discrete Control Dyn B 18(4):1031–1051. https://doi.org/10.3934/dcdsb.2013.18.1031
Lenhart S, Workman JT (2007) Optimal control applied to biological models. Chapman and Hall, London. https://doi.org/10.1201/9781420011418
Lollini PL, Motta S, Pappalardo F (2006) Discovery of cancer vaccination protocols with a genetic algorithm driving an agent based simulator. BMC Bioinform 7(1):352. https://doi.org/10.1186/1471-2105-7-352
Marler RT, Arora JS (2004) Survey of multi-objective optimization methods for engineering. Struct Multidiscip Optim 26(6):369–395. https://doi.org/10.1007/s00158-003-0368-6
Minelli A, Topputo F, Bernelli-Zazzera F (2011) Controlled drug delivery in cancer immunotherapy: stability, optimization, and Monte Carlo analysis. SIAM J Appl Math 71(6):2229–2245. https://doi.org/10.1137/100815190
Pandey HM, Chaudhary A, Mehrotra D (2014) A comparative review of approaches to prevent premature convergence in GA. Appl Soft Comput 24:1047–1077. https://doi.org/10.1016/j.asoc.2014.08.025
Pennisi MA, Pappalardo F, Zhang P, Motta S (2009) Searching of optimal vaccination schedules. IEEE Eng Med Biol Mag 28(4):67–72. https://doi.org/10.1109/MEMB.2009.932919
Piccoli B, Castiglione F (2006) Optimal vaccine scheduling in cancer immunotherapy. Physica A 370(2):672–680. https://doi.org/10.1016/j.physa.2006.03.011
Pillis LGD, Radunskaya AE (2003) The dynamics of an optimally controlled tumor model: a case study. Math Comput Model 37(11):1221–1244. https://doi.org/10.1016/S0895-7177(03)00133-X
Pillis LGD, Fister KR, Gu W, Head T, Maples K, Neal T, Murugan A, Kozai K (2008) Optimal control of mixed immunotherapy and chemotherapy of tumors. J Biol Syst 16(1):51–80. https://doi.org/10.1142/S0218339008002435
Pontryagin LS, Boltyansky VG, Gamkrelidze RV, Mishchenko EF (1962) The mathematical theory of optimal processes. Interscience Publishers, New York
Qomlaqi M, Bahrami F, Ajami M, Hajati J (2017) An extended mathematical model of tumor growth and its interaction with the immune system, to be used for developing an optimized immunotherapy treatment protocol. Math Biosci 292:1–9. https://doi.org/10.1016/j.mbs.2017.07.006
Ravindran NS, Sheriff MM, Krishnapriya P (2017) Analysis of tumour-immune evasion with chemo-immuno therapeutic treatment with quadratic optimal control. J Biol Dyn 11(1):480–503. https://doi.org/10.1080/17513758.2017.1381280
Rosenberg SA (2014) IL-2: the first effective immunotherapy for human cancer. J Immunol 192(12):5451–5458. https://doi.org/10.4049/jimmunol.1490019
Rosenberg SA, Restifo NP (2015) Adoptive cell transfer as personalized immunotherapy for human cancer. Science 348(6230):62–68. https://doi.org/10.1126/science.aaa4967
Ross IM, Karpenko M (2012) A review of pseudospectral optimal control: from theory to flight. Annu Rev Control 36(2):182–197. https://doi.org/10.1016/j.arcontrol.2012.09.002
Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of 1998 IEEE international conference on evolutionary computation. IEEE world congress on computational intelligence. IEEE, pp 69–73. https://doi.org/10.1109/ICEC.1998.699146
Soto-Ortiz L, Finley SD (2016) A cancer treatment based on synergy between anti-angiogenic and immune cell therapies. J Theor Biol 397:197–211. https://doi.org/10.1016/j.jtbi.2016.01.026
Spranger S, Dai D, Horton B, Gajewski TF (2017) Tumor-residing Batf3 dendritic cells are required for effector T cell trafficking and adoptive T cell therapy. Cancer Cell 31(5):711–723. https://doi.org/10.1016/j.ccell.2017.04.003
Tran E, Robbins PF, Rosenberg SA (2017) ’Final common pathway’ of human cancer immunotherapy: targeting random somatic mutations. Nat Immunol 18(3):255–262. https://doi.org/10.1038/ni.3682
Valentinuzzi D, Simoncic U, Ursic K, Vrankar M, Turk M, Jeraj R (2018) Predicting tumour response to anti-PD-1 immunotherapy with computational modelling. Phys Med Biol. https://doi.org/10.1088/1361-6560/aaf96c
Vrána D, Matzenauer M, Neoral Č, Aujeskỳ R, Vrba R, Melichar B, Rušarová N, Rušarová N, Bartoušková M, Jankowski J (2018) From tumor immunology to immunotherapy in gastric and esophageal cancer. Int J Mol Sci 20(1):13. https://doi.org/10.3390/ijms20010013
Wilson DR, Sen R, Sunshine JC, Pardoll DM, Green JJ, Kim YJ (2018) Biodegradable STING agonist nanoparticles for enhanced cancer immunotherapy. Nanomed Nanotechnol Biol Med 14(2):237–246. https://doi.org/10.1016/j.nano.2017.10.013
Acknowledgements
The authors would like to express their deep gratitude towards the reviewers for their constructive advice, invaluable comments, and support. Furthermore, the authors are grateful to the editorial board for making helpful comments on the work.
Author information
Authors and Affiliations
Contributions
Conceptualization: SSA; methodology: SSA; formal analysis: SSA; Writing–original draft: SSA; supervision: SSA; Writing–review and editing: SSA and AM; Software SSA and AM; validation: SSA; resources: AM; and visualization: AM.
Corresponding author
Ethics declarations
Funding
This study has not been funded
Conflict of interest
The authors declare that they have no conflict of interest
Ethical Approval
This work does not contain any studies with human participants or animals, performed by any of the authors, and any work involving chemicals, procedures or equipment that have any unusual hazards inherent in their use.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sarv Ahrabi, S., Momenzadeh, A. Metaheuristics and Pontryagin’s minimum principle for optimal therapeutic protocols in cancer immunotherapy: a case study and methods comparison. J. Math. Biol. 81, 691–723 (2020). https://doi.org/10.1007/s00285-020-01525-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00285-020-01525-7
Keywords
- Cancer immunotherapy
- Optimal control
- Metaheuristics
- Particle swarm optimization
- Genetic algorithm
- Pontryagin’s minimum principle
- Forward-backward sweep method