In this article, we study a control problem in an appropriate space of random variables; in fact, in our set up, we can consider an arbitrary Hilbert space, yet we specialize only to a Hilbert space of square-integrable random variables. We see that the control problem can then be related to a mean field type control problem. We explore here a suggestion of Lions in (Lectures at College de France, http://www.college-de-france.fr) and (Seminar at College de France). Mean field type control problems are control problems in which functionals depend on probability measures of the underlying controlled process. Gangbo and Święch [J. Differ. Equ. 259 (2015) 6573–6643] considered this type of problem in the space of probability measures equipped with the Wasserstein metric and use the concept of Wasserstein gradient; their work provides a completely rigorous treatment, but it is quite intricate, because metric spaces are not vector spaces. The approach suggested by Lions overcomes this difficulty. Nevertheless, our present proposed approach also benefits from the useful concept of L-derivatives as introduced in a recent interesting treatise of Carmona and Delarue [Probabilistic Theory of Mean Field Games with Applications. Springer Verlag (2017)]. We also consider Bellman equation and the Master equation of mean field type control. We provide also some extension of the results of Gangbo and Święch [J. Differ. Equ. 259 (2015) 6573–6643].
Accepté le :
DOI : 10.1051/cocv/2018034
Mots-clés : Mean field theory, Master equations, Wasserstein space, random forward-backward differential equations, linear quadratic setting
@article{COCV_2019__25__A10_0, author = {Bensoussan, Alain and Yam, Sheung Chi Phillip}, title = {Control problem on space of random variables and master equation}, journal = {ESAIM: Control, Optimisation and Calculus of Variations}, publisher = {EDP-Sciences}, volume = {25}, year = {2019}, doi = {10.1051/cocv/2018034}, zbl = {1450.35305}, mrnumber = {3943358}, language = {en}, url = {http://www.numdam.org/articles/10.1051/cocv/2018034/} }
TY - JOUR AU - Bensoussan, Alain AU - Yam, Sheung Chi Phillip TI - Control problem on space of random variables and master equation JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2019 VL - 25 PB - EDP-Sciences UR - http://www.numdam.org/articles/10.1051/cocv/2018034/ DO - 10.1051/cocv/2018034 LA - en ID - COCV_2019__25__A10_0 ER -
%0 Journal Article %A Bensoussan, Alain %A Yam, Sheung Chi Phillip %T Control problem on space of random variables and master equation %J ESAIM: Control, Optimisation and Calculus of Variations %D 2019 %V 25 %I EDP-Sciences %U http://www.numdam.org/articles/10.1051/cocv/2018034/ %R 10.1051/cocv/2018034 %G en %F COCV_2019__25__A10_0
Bensoussan, Alain; Yam, Sheung Chi Phillip. Control problem on space of random variables and master equation. ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 10. doi : 10.1051/cocv/2018034. http://www.numdam.org/articles/10.1051/cocv/2018034/
[1] Applied Functional Analysis, 2nd edn. Wiley (2000) 520. | MR | Zbl
,[2] Wellposedness of mean field games with common noise under a weaker monotonicity condition. SIAM J. Control Optim. 54 (2016) 30–48. | DOI | MR | Zbl
,[3] Gradient Flows: in Metric Spaces and in the Space of Probability Measures, 2nd edn. Lectures in Mathematics, ETH Zürich. Birkhäuser, Basel (2008). | MR | Zbl
, and ,[4] A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer. Math. 84 (2000) 375–393. | DOI | MR | Zbl
and ,[5] Mean Field Games and Mean Field Type Control Theory. Springer Briefs in Mathematics. Springer Verlag, New York, Heidelberg, Dordrecht, London (2013). | DOI | MR | Zbl
, and ,[6] The Master equation in mean field theory. J. Math. Pures et Appl. 103 (2014) 1441–1474. | DOI | MR | Zbl
, and ,[7] On the interpretation of the Master equation. Stoch. Process. Appl. 127 (2015) 2093–137. | DOI | MR | Zbl
, and ,[8] Polar factorization and monotone rearrangement of vector-valued functions. Comm. Pure Appl. Math. 44 (1991) 375–417. | DOI | MR | Zbl
,[9] Notes on P.L. Lions’ lectures at the College de France, Working Paper, September (2013).
,[10] The Master equation for large population equilibriums, in Stochastic Analysis and Applications, edited by , , and . Springer, Cham (2014) 77–128. | MR
and ,[11] Probabilistic Theory of Mean Field Games with Applications. Springer Verlag (2017).
and ,[12] Mean field games and systemic risk. Commun. Math. Sci. 13 (2015) 911–933. | DOI | MR | Zbl
, and ,[13] Existence of a solution to an equation arising from the theory of mean field games. J. Differ. Equ. 259 (2015) 6573–6643. | DOI | MR | Zbl
and ,[14] The variational formulation of the Fokker-Planck equation. SIAM: J. Math.Anal. 29 (1998) 1–17. | MR | Zbl
, and ,[15] Mean field games. Jpn. J. Math. 2 (2007) 229–260. | DOI | MR | Zbl
and ,[16] Dynamic programming for mean field type control. CRAS 352 (2014) 707–713. | MR | Zbl
, ,[17] Lectures at College de France. Available at: http://www.college-de-france.fr.
,[18] Seminar at College de France, November 14 (2014).
,[19] The geometry of dissipative evolution equations: the porous medium equation. Commun. Partial Differ. Equ. 26 (2001) 101–174. | DOI | MR | Zbl
,[20] Optimal Transport: Old and New. In Vol. 338 of Grundlehren der Mathematischen Wissenschaften. Springer, Berlin (2009). | MR | Zbl
,Cité par Sources :