Skip to main content
Log in

Maximum Principle for Stochastic Optimal Control Problem with Distributed Delays

  • Published:
Acta Mathematica Scientia Aims and scope Submit manuscript

Abstract

This paper is concerned with a Pontryagin’s maximum principle for the stochastic optimal control problem with distributed delays given by integrals of not necessarily linear functions of state or control variables. By virtue of the duality method and the generalized anticipated backward stochastic differential equations, we establish a necessary maximum principle and a sufficient verification theorem. In particular, we deal with the controlled stochastic system where the distributed delays enter both the state and the control. To explain the theoretical results, we apply them to a dynamic advertising problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Mohammed S-E A. Stochastic differential equations with memory: theory, examples and applications//Progress in probability, stochasic analysis and related topics 6. Birkhaser: The geido workshop, 1998

    MATH  Google Scholar 

  2. Arriojas M, Hu Y, Mohammed S-E A, Pap G. A delayed Black and Scholes formula. Stoch Anal Appl, 2007, 25(2): 471–492

    Article  MathSciNet  Google Scholar 

  3. Øksendal B, Sulem A. A maximum principle for optimal control of stochastic systems with delay, with applications to finance//Menaldi J M, Rofman E, Sulem A. Optimal Control and Partial Differential Equations. 64–79. Amsterdam, The Netherlands: ISO Press, 2000

    MATH  Google Scholar 

  4. Larssen B. Dynamic programming in stochastic control of systems with delay. Stoch Stoch Rep, 2002, 74: 651–673

    Article  MathSciNet  Google Scholar 

  5. Peng S G, Yang Z. Anticipated backward stochastic differential equations. Ann Probab, 2009, 37(3): 877–902

    Article  MathSciNet  Google Scholar 

  6. Chen L, Wu Z. Maximum principle for the stochastic optimal control problem with delay and application. Automatica, 2010, 46: 1074–1080

    Article  MathSciNet  Google Scholar 

  7. Yu Z Y. The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls. Automatica, 2012, 56(6): 1401–1406

    Google Scholar 

  8. Chen L, Yu Z Y. Maximum principle for nonzero-sum stochastic differential game with delays. IEEE T Automat Contr, 2015, 60(5): 1422–1426

    Article  MathSciNet  Google Scholar 

  9. Gozzi F, Marinelli C. Stochastic optimal control of delay equations arising in advertising models//Stochastic Partial Differential Equations & Applications-VII. Papers of the 7th meeting, Levico, Terme, Italy, January 5–10, 2004. Boca Raton, FL: Chapman and Hall/CRC. Lecture Notes in Pure and Applied Mathematics, 2006, 245: 133–148

  10. Nerlove M, Arrow J K. Optimal advertising policy under dynamic conditions. Economica, 1962, 29: 129–142

    Article  Google Scholar 

  11. Agram N, Haadem S, Üksendal B, Proske F. A maximum principle for infinite horizon delay equations. SIAM J Math Anal, 2013, 45: 2499–522

    Article  MathSciNet  Google Scholar 

  12. Shen Y, Meng Q X, Shi P. Maximum principle for mean-field jump-diffusion stochastic delay differential equations and its application to finance. Automatica, 2014, 50(6): 1565–1579

    Article  MathSciNet  Google Scholar 

  13. Øksendal B, Sulem A, Zhang T. Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations. Adv Appl Probab, 2011, 43(2): 572–596

    Article  MathSciNet  Google Scholar 

  14. Meng Q X, Shen Y. Optimal control of mean-field jump-diffusion systems with delay: A stochastic maximum principle approach. J Comput Appl Math, 2015, 279: 13–30

    Article  MathSciNet  Google Scholar 

  15. Yang Z, Elliott R J. Some properties of generalized anticipated backward stochastic differential equations. Electro Commun Prob, 2013, 18(63): 1–10

    MathSciNet  MATH  Google Scholar 

  16. Agram N, Øksendal B. Mean-field stochastic control with elephant memory in finite and infinite time horizon. Stochastics, 2019, 91(7): 1041–1066

    Article  MathSciNet  Google Scholar 

  17. Xu X M. Fully coupled forward-backward stochastic functional differential equations and applications to quadratic optimal control. 2013, arXiv:1310.6846

  18. Garzon J, Tindel S, Torres S. Euler scheme for fractional delay stochastic differential equations by rough paths techniques. Acta Mathematica Scientia, 2019, 39B(3): 747–763

    Article  MathSciNet  Google Scholar 

  19. Zhang W S, Chen Y P, Numerical analysis for Volterra integral equation with two kinds of delay. Acta Mathematica Scientia, 2019, 39B(2): 602–617

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qixia Zhang.

Additional information

The author is supported by the National Natural Science Foundation of China (11701214) and Shandong Provincial Natural Science Foundation, China (ZR2019MA045).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Q. Maximum Principle for Stochastic Optimal Control Problem with Distributed Delays. Acta Math Sci 41, 437–449 (2021). https://doi.org/10.1007/s10473-021-0208-z

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10473-021-0208-z

Key words

2010 MR Subject Classification

Navigation