Abstract
This paper is concerned with a linear quadratic optimal control problem of delayed backward stochastic differential equations. An explicit representation is derived for the optimal control, which is a linear feedback of the entire past history and the expected value of the future state trajectory in a short period of time. To obtain the optimal feedback, a new class of delayed Riccati equations and delayed-advanced forward-backward stochastic differential equations are introduced. Furthermore, the unique solvability of their solutions are discussed in detail.
Similar content being viewed by others
References
Chen, L., Huang, J.H.: Stochastic maximum principle for controlled backward delayed system via advanced stochastic differential equation. J. Optim. Theory Appl. 167, 1112–1135 (2015)
Chen, L., Wu, Z.: Maximum principle for the stochastic optimal control problem with delay and application. Automatica 46, 1074–1080 (2010)
Chen, L., Wu, Z., Yu, Z.Y.: Delayed stochastic linear-quadratic control problem and related applications. J. Appl. Math. (2012)
Delong, L.: Applications of time-delayed backward stochastic differential equations to pricing, hedging and management of financial and insurance risks. Appl. Math. 39, 463–488 (2012)
Delong, L., Imkeller, P.: Backward stochastic differential equation with time delayed generators-results and counterexamples. Ann. Appl. Probab. 20, 1512–1536 (2010)
Du, H., Huang, J.H., Qin, Y.L.: A stochastic maximum principle for delayed mean-field stochastic differential equations and its applications. IEEE Trans. Autom. Control 58, 3212–3217 (2013)
Dokuchaev, N., Zhou, X.Y.: Stochastic controls with terminal contingent conditions. J. Math. Anal. Appl. 238, 143–165 (1999)
Gopalsamy, K.: Nonoscillation in systems of linear differential equations with delayed and advanced arguments. J. Math. Anal. Appl. 140, 374–380 (1989)
Huang, J.H., Li, X., Shi, J.T.: Forward-backward linear quadratic stochastic optimal control problem with delay. Syst. Control Lett. 61, 623–630 (2012)
Huang, J.H., Shi, J.T.: Maximum principle for optimal control of fully coupled forward-backward stochastic differential delayed equations. ESAIM. COCV 18, 1073–1096 (2012)
Huang, J.H., Wang, G.C., Xiong, J.: A maximum principle for partial information backward stochastic control problem with applications. SIAM J. Control Optim. 48, 2106–2117 (2009)
Li, N., Wang, Y., Wu, Z.: An indefinite stochastic linear quadratic optimal control problem with delay and related forward-backward stochastic differential equations. J. Optim. Theory Appl. 179, 722–744 (2018)
Li, N., Wang, G.C., Wu, Z.: Linear quadratic optimal control problem for time-delay stochastic system with recursive utility under full and partial information. Automatica 121, 109169 (2020)
Li, X., Sun, J.R., Xiong, J.: Linear quadratic optimal control problems for mean-field backward stochastic differential equations. Appl. Math. Optim. 80, 2123–250 (2019)
Lim, A.E.B., Zhou, X.Y.: Linear-quadratic control of backward stochastic differential equations. IEEE Trans. Autom. Control 40, 450–474 (2001)
Li, X.Y., Zhu, D.M.: Oscillation and nonoscillation of advanced differential equations with variable coefficients. J. Math. Anal. Appl 269, 462–488 (2002)
Mohammed, S.E.A.: Stochastic Functional Differential Equations. Pitman, Boston (1984)
Mohammed, S.E.A.: Stochastic differential equations with memory: theory, examples and applications. Progress in Probability, Stochastic Analysis and Related Topics 6. Birkhauser, The Geido Workshop (1996)
Øksendal, B., Sulem, A.: A maximum principle for optimal control of stochastic systems with delay, with applications to finance. In: Menaldi, J.M., Rofman, E., Sulem, A. (eds.) Optimal Control and Partial Differential Equations, pp. 64–79. ISO Press, Amsterdam (2000)
Øksendal, B., Sulem, A., Zhang, T.S.: Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations. Adv. Appl. Probab. 43, 572–596 (2011)
Pardoux, E., Peng, S.G.: Adapted solution of a backward stochastic differential equation. Syst. Control Lett. 14, 55–61 (1990)
Peng, S.G.: Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27, 125–144 (1993)
Peng, S.G., Yang, Z.: Anticipated backward stochastic differential equations. Ann. Probab. 37, 877–902 (2009)
Shi, J.T.: Optimal control of backward stochastic differential equations with time delayed generators. In: Proc. 30th Chinese Control Conf., pp. 1285–1289, Yantai, July 22–24 (2011)
Shi, J.T.: Optimal control of BSDEs with time delayed generators driven by Brownian motions and Poisson random measures. In: Proc. 32nd Chinese Control Conf., pp. 1575–1580, Xi’an, July 26–28 (2013)
Shan, S.M., Wiener, J.: Advanced differential equations with piecewise constant argument deviations. Inter. J. Math. Math. Sci. 6, 671–703 (2007)
Shi, J.T., Wang, G.C.: A nonzero sum differential game of BSDE with time-delayed generator and applications. IEEE Trans. Autom. Control 61, 1959–1964 (2016)
Wang, G.C., Xiao, H., Xiong, J.: A kind of LQ non-zero sum differential game of backward stochastic differential equations with asymmetric information. Automatica 97, 346–352 (2018)
Wang, G.C., Yu, Z.Y.: A Pontryagins maximum principle for non-zero sum differential games of BSDEs with applications. IEEE Trans. Autom. Control 55, 1742–1747 (2010)
Wang, G.C., Yu, Z.Y.: A partial information non-zero sum differential game of backward stochastic differential equations with applications. Automatica 48, 342–352 (2012)
Wu, S., Shu, L.: Partially observed linear quadratic control problem with delay via backward separation method. Optim. Control Appl. Meth. 38, 814–828 (2017)
Wu, S., Wang, G.C.: Optimal control problem of backward stochastic differential delay equation under partial information. Syst. Control Lett. 82, 71–78 (2015)
Xu, J.J., Shi, J.T., Zhang, H.S.: A leader-follower stochastic linear quadratic differential game with time delay. Sci. China Inf. Sci. 61, 112202:1-112202:13 (2018)
Yong, J.M., Zhou, X.Y.: Stochastic Controls: Hamiltonian Systems and HJB Equations. Springer-Verlag, New York (1999)
Yu, Z.Y.: The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls. Automatica 48, 2420–2432 (2012)
Yu, Z.Y., Ji, S.L.: Linear-quadratic non-zero sum differential game of backward stochastic differential equations. In: Proc. 27th Chinese Control Conference, pp. 562–566, Kunming, China, July 16–18 (2008)
Zhang, H.S., Xu, J.J.: Control for Itô stochastic systems with input delay. IEEE Trans. Autom. Control 62, 350–365 (2017)
Acknowledgements
The authors would like to thank the editor and two anonymous referees for their constructive and insightful comments for improving the quality of this work. Many thanks for discussion and suggestions with Professor Li Chen at China University of Mining and Technology (Beijing).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work is financially supported by the National Key R&D Program of China (2018YFB1305400), the National Natural Science Foundations of China (11971266, 11571205, 11831010), and Shandong Provincial Natural Science Foundations (Grant Nos. ZR2020ZD24, ZR2019ZD42).
Rights and permissions
About this article
Cite this article
Meng, W., Shi, J. Linear Quadratic Optimal Control Problems of Delayed Backward Stochastic Differential Equations. Appl Math Optim 84 (Suppl 1), 523–559 (2021). https://doi.org/10.1007/s00245-021-09778-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-021-09778-4
Keywords
- Linear quadratic optimal control
- Stochastic differential delayed equation
- Delayed backward stochastic differential equation
- Time-advanced stochastic differential delayed equation
- Delayed Riccati equation
- Delayed-advanced forward–backward stochastic differential equation