Abstract
This paper is concerned with a Pontryagin’s maximum principle for the stochastic optimal control problem with distributed delays given by integrals of not necessarily linear functions of state or control variables. By virtue of the duality method and the generalized anticipated backward stochastic differential equations, we establish a necessary maximum principle and a sufficient verification theorem. In particular, we deal with the controlled stochastic system where the distributed delays enter both the state and the control. To explain the theoretical results, we apply them to a dynamic advertising problem.
Similar content being viewed by others
References
Mohammed S-E A. Stochastic differential equations with memory: theory, examples and applications//Progress in probability, stochasic analysis and related topics 6. Birkhaser: The geido workshop, 1998
Arriojas M, Hu Y, Mohammed S-E A, Pap G. A delayed Black and Scholes formula. Stoch Anal Appl, 2007, 25(2): 471–492
Øksendal B, Sulem A. A maximum principle for optimal control of stochastic systems with delay, with applications to finance//Menaldi J M, Rofman E, Sulem A. Optimal Control and Partial Differential Equations. 64–79. Amsterdam, The Netherlands: ISO Press, 2000
Larssen B. Dynamic programming in stochastic control of systems with delay. Stoch Stoch Rep, 2002, 74: 651–673
Peng S G, Yang Z. Anticipated backward stochastic differential equations. Ann Probab, 2009, 37(3): 877–902
Chen L, Wu Z. Maximum principle for the stochastic optimal control problem with delay and application. Automatica, 2010, 46: 1074–1080
Yu Z Y. The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls. Automatica, 2012, 56(6): 1401–1406
Chen L, Yu Z Y. Maximum principle for nonzero-sum stochastic differential game with delays. IEEE T Automat Contr, 2015, 60(5): 1422–1426
Gozzi F, Marinelli C. Stochastic optimal control of delay equations arising in advertising models//Stochastic Partial Differential Equations & Applications-VII. Papers of the 7th meeting, Levico, Terme, Italy, January 5–10, 2004. Boca Raton, FL: Chapman and Hall/CRC. Lecture Notes in Pure and Applied Mathematics, 2006, 245: 133–148
Nerlove M, Arrow J K. Optimal advertising policy under dynamic conditions. Economica, 1962, 29: 129–142
Agram N, Haadem S, Üksendal B, Proske F. A maximum principle for infinite horizon delay equations. SIAM J Math Anal, 2013, 45: 2499–522
Shen Y, Meng Q X, Shi P. Maximum principle for mean-field jump-diffusion stochastic delay differential equations and its application to finance. Automatica, 2014, 50(6): 1565–1579
Øksendal B, Sulem A, Zhang T. Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations. Adv Appl Probab, 2011, 43(2): 572–596
Meng Q X, Shen Y. Optimal control of mean-field jump-diffusion systems with delay: A stochastic maximum principle approach. J Comput Appl Math, 2015, 279: 13–30
Yang Z, Elliott R J. Some properties of generalized anticipated backward stochastic differential equations. Electro Commun Prob, 2013, 18(63): 1–10
Agram N, Øksendal B. Mean-field stochastic control with elephant memory in finite and infinite time horizon. Stochastics, 2019, 91(7): 1041–1066
Xu X M. Fully coupled forward-backward stochastic functional differential equations and applications to quadratic optimal control. 2013, arXiv:1310.6846
Garzon J, Tindel S, Torres S. Euler scheme for fractional delay stochastic differential equations by rough paths techniques. Acta Mathematica Scientia, 2019, 39B(3): 747–763
Zhang W S, Chen Y P, Numerical analysis for Volterra integral equation with two kinds of delay. Acta Mathematica Scientia, 2019, 39B(2): 602–617
Author information
Authors and Affiliations
Corresponding author
Additional information
The author is supported by the National Natural Science Foundation of China (11701214) and Shandong Provincial Natural Science Foundation, China (ZR2019MA045).
Rights and permissions
About this article
Cite this article
Zhang, Q. Maximum Principle for Stochastic Optimal Control Problem with Distributed Delays. Acta Math Sci 41, 437–449 (2021). https://doi.org/10.1007/s10473-021-0208-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10473-021-0208-z
Key words
- Distributed delay
- generalized anticipated backward stochastic differential equations
- optimal control
- maximum principle