Near-optimal control problems for forward-backward regime-switching systems

Li, Min; Wu, Zhen

ESAIM: Control, Optimisation and Calculus of Variations, Tome 26 (2020), article no. 94.

Suite au passage du modèle économique de la revue en S20, le texte intégral des articles des années 2019 et 2020 est accessible uniquement sur le site de l'éditeur et est réservé aux abonnés.

This paper investigates the near-optimality for a class of forward-backward stochastic differential equations (FBSDEs) with continuous-time finite state Markov chains. The control domains are not necessarily convex and the control variables do not enter forward diffusion term. Some new estimates for state and adjoint processes arise naturally when we consider the near-optimal control problem in the framework of regime-switching. Inspired by Ekeland’s variational principle and a spike variational technique, the necessary conditions are derived, which imply the near-minimum condition of the Hamiltonian function in an integral sense. Meanwhile, some certain convexity conditions and the near-minimum condition are sufficient for the near-optimal controls with order $$. A recursive utility investment consumption problem is discussed to illustrate the effectiveness of our theoretical results.

[1] K. Bahlali, N. Khelfallah and B. Mezerdi, Necessary and sufficient conditions for near-optimality in stochastic control of FBSDEs. Syst. Control Lett. 58 (2009) 857–864. | DOI | MR | Zbl

[2] J.M. Bismut, An introductory approach to duality in optimal stochastic control. SIAM Rev. 20 (1978) 62–78. | DOI | MR | Zbl

[3] N.P.B. Bollen, Valuing options in regime-switching models. J. Deriv. 6 (1998) 38–50. | DOI

[4] J. Buffington and R.J. Elliott, American options with regime switching. Theor. Appl. Finance 5 (2002) 497–514. | DOI | MR | Zbl

[5] S. Crépey and A. Matoussi, Reflected and doubly reflected BSDEs with jumps: a priori estimates and comparison. Ann. Appl. Probab. 18 (2008) 2041–2069. | DOI | MR | Zbl

[6] D. Duffie and L.G. Epstein, Stochastic differential utility. Econometrica 60 (1992) 353–394. | DOI | MR | Zbl

[7] I. Ekeland, On the variational principle. J. Math. Anal. Appl. 47 (1974) 324–353. | DOI | MR | Zbl

[8] J.D. Hamilton, A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57 (1989) 357–384. | DOI | MR | Zbl

[9] Y. Hu and S. Peng, Solution of forward-backward stochastic differential equations. Probab. Theory Relat. Field 103 (1995) 273–283. | DOI | MR | Zbl

[10] J. Huang and J. Shi, Maximum principle for optimal control of fully coupled forward-backward stochastic differential delayed equations. ESAIM: COCV 18 (2012) 1073–1096. | Numdam | MR | Zbl

[11] J. Huang, X. Li and G. Wang, Near-optimal control problems for linear forward-backward stochastic systems. Automatica 46 (2010) 397–404. | DOI | MR | Zbl

[12] N.E. Karoui, S. Peng and M.C. Quenez, Backward stochastic differential equations in finance. Math. Finance 7 (1997) 1–71. | DOI | MR | Zbl

[13] J. Ma and J. Yong, Forward-backward stochastic differential equations and their applications. Springer-Verlag, Berlin (1999). | Zbl

[14] J. Ma, P. Protter, and J. Yong, Solving forward-backward stochastic differential equations explicitly − a four step scheme. Probab. Theory Relat. Fields 98 (1994) 339–359. | DOI | MR | Zbl

[15] G.B.Di. Masi, Y.M. Kabanov and W.J. Runggaldier, Mean-variance hedging of options on stocks with Markov volatilities. Theory Prob. App. 39 (1995) 172–182. | DOI | MR | Zbl

[16] E. Pardoux and S. Peng, Adapted solution of a backward stochastic differential equation. Syst. Control Lett. 14 (1990) 55–61. | DOI | MR | Zbl

[17] E. Pardoux and S. Tang, Forward-backward stochastic differential equations and quasilinear parabolic PDEs. Probab. Theory Relat. Fields. 114 (1999) 123–150. | DOI | MR | Zbl

[18] S. Peng, Backward stochastic differential equations and applications to optimal control. Appl. Math. Optim. 27 (1993) 125–144. | DOI | MR | Zbl

[19] S. Peng and Z. Wu, Fully coupled forward-backward stochastic differential equations and applications to optimal control. SIAM J. Control Optim. 37 (1999) 825–843. | DOI | MR | Zbl

[20] R. Tao and Z. Wu, Maximum principle for optimal control problems of forward-backward regime-switching system and applications. Syst. Control Lett. 61 (2012) 911–917. | DOI | MR | Zbl

[21] R. Tao, Z. Wu and Q. Zhang, BSDEs with regime switching: Weak convergence and applications. J. Math. Anal. Appl. 407 (2013) 97–111. | DOI | MR | Zbl

[22] Z. Wu, A general maximum principle for optimal control of forward–backward stochastic systems. Automatica 49 (2013) 1473–1480. | DOI | MR | Zbl

[23] J. Yong and X. Zhou, Stochastic controls: Hamiltonian systems and HJB equations. Springer-Verlag, New York (1999). | DOI | MR | Zbl

[24] Z. Yu, Infinite horizon jump-diffusion forward-backward stochastic differential equations and their application to backward linear-quadratic problems. ESAIM: COCV 23 (2017) 1331–1359. | Numdam | MR | Zbl

[25] Q. Zhang, Stock trading: an optimal selling rule. SIAM J. Control Optim. 40 (2001) 64–87. | DOI | MR | Zbl

[26] Q. Zhang and G. Yin, Nearly-optimal asset allocation in hybrid stock investment models. J. Optim. Theory Appl. 121 (2004) 419–444. | DOI | MR | Zbl

[27] L. Zhang, J. Huang and X. Li, Necessary condition for near optimal control of linear forward-backward stochastic differential equations. Int. J. Control 88 (2015) 1594–1608. | DOI | MR | Zbl

[28] X. Zhou, Deterministic near-optimal control, Part I: necessary and sufficient conditions for near-optimality. J. Optim. Theory Appl. 85 (1995) 473–488. | DOI | MR | Zbl

[29] X. Zhou, Stochastic near-optimal controls: necessary and sufficient conditions for near-optimality. SIAM J. Control Optim. 36 (1998) 929–947. | DOI | MR | Zbl

[30] X. Zhou and G. Yin, Markowitz’s mean-variance portfolio selection with regime switching: A continuous-time model. SIAM J. Control Optim. 42 (2003) 1466–1482. | DOI | MR | Zbl