Control problem on space of random variables and master equation
ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 10.

In this article, we study a control problem in an appropriate space of random variables; in fact, in our set up, we can consider an arbitrary Hilbert space, yet we specialize only to a Hilbert space of square-integrable random variables. We see that the control problem can then be related to a mean field type control problem. We explore here a suggestion of Lions in (Lectures at College de France, http://www.college-de-france.fr) and (Seminar at College de France). Mean field type control problems are control problems in which functionals depend on probability measures of the underlying controlled process. Gangbo and Święch [J. Differ. Equ. 259 (2015) 6573–6643] considered this type of problem in the space of probability measures equipped with the Wasserstein metric and use the concept of Wasserstein gradient; their work provides a completely rigorous treatment, but it is quite intricate, because metric spaces are not vector spaces. The approach suggested by Lions overcomes this difficulty. Nevertheless, our present proposed approach also benefits from the useful concept of L-derivatives as introduced in a recent interesting treatise of Carmona and Delarue [Probabilistic Theory of Mean Field Games with Applications. Springer Verlag (2017)]. We also consider Bellman equation and the Master equation of mean field type control. We provide also some extension of the results of Gangbo and Święch [J. Differ. Equ. 259 (2015) 6573–6643].

Reçu le :
Accepté le :
DOI : 10.1051/cocv/2018034
Classification : 35R15, 49L25, 49N70, 91A13, 93E20, 60H30, 60H10, 60H15, 60F99
Mots-clés : Mean field theory, Master equations, Wasserstein space, random forward-backward differential equations, linear quadratic setting
Bensoussan, Alain 1 ; Yam, Sheung Chi Phillip 1

1
@article{COCV_2019__25__A10_0,
     author = {Bensoussan, Alain and Yam, Sheung Chi Phillip},
     title = {Control problem on space of random variables and master equation},
     journal = {ESAIM: Control, Optimisation and Calculus of Variations},
     publisher = {EDP-Sciences},
     volume = {25},
     year = {2019},
     doi = {10.1051/cocv/2018034},
     zbl = {1450.35305},
     mrnumber = {3943358},
     language = {en},
     url = {http://www.numdam.org/articles/10.1051/cocv/2018034/}
}
TY  - JOUR
AU  - Bensoussan, Alain
AU  - Yam, Sheung Chi Phillip
TI  - Control problem on space of random variables and master equation
JO  - ESAIM: Control, Optimisation and Calculus of Variations
PY  - 2019
VL  - 25
PB  - EDP-Sciences
UR  - http://www.numdam.org/articles/10.1051/cocv/2018034/
DO  - 10.1051/cocv/2018034
LA  - en
ID  - COCV_2019__25__A10_0
ER  - 
%0 Journal Article
%A Bensoussan, Alain
%A Yam, Sheung Chi Phillip
%T Control problem on space of random variables and master equation
%J ESAIM: Control, Optimisation and Calculus of Variations
%D 2019
%V 25
%I EDP-Sciences
%U http://www.numdam.org/articles/10.1051/cocv/2018034/
%R 10.1051/cocv/2018034
%G en
%F COCV_2019__25__A10_0
Bensoussan, Alain; Yam, Sheung Chi Phillip. Control problem on space of random variables and master equation. ESAIM: Control, Optimisation and Calculus of Variations, Tome 25 (2019), article no. 10. doi : 10.1051/cocv/2018034. http://www.numdam.org/articles/10.1051/cocv/2018034/

[1] J.P. Aubin, Applied Functional Analysis, 2nd edn. Wiley (2000) 520. | MR | Zbl

[2] S. Ahuja, Wellposedness of mean field games with common noise under a weaker monotonicity condition. SIAM J. Control Optim. 54 (2016) 30–48. | DOI | MR | Zbl

[3] L. Ambrosio, N. Gigli and G. Savaré, Gradient Flows: in Metric Spaces and in the Space of Probability Measures, 2nd edn. Lectures in Mathematics, ETH Zürich. Birkhäuser, Basel (2008). | MR | Zbl

[4] J.-D. Benamou and Y. Brenier, A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem. Numer. Math. 84 (2000) 375–393. | DOI | MR | Zbl

[5] A. Bensoussan, J. Frehse and P. Yam, Mean Field Games and Mean Field Type Control Theory. Springer Briefs in Mathematics. Springer Verlag, New York, Heidelberg, Dordrecht, London (2013). | DOI | MR | Zbl

[6] A. Bensoussan, J. Frehse and S.C.P. Yam, The Master equation in mean field theory. J. Math. Pures et Appl. 103 (2014) 1441–1474. | DOI | MR | Zbl

[7] A. Bensoussan, J. Frehse and S.C.P. Yam, On the interpretation of the Master equation. Stoch. Process. Appl. 127 (2015) 2093–137. | DOI | MR | Zbl

[8] Y. Brenier, Polar factorization and monotone rearrangement of vector-valued functions. Comm. Pure Appl. Math. 44 (1991) 375–417. | DOI | MR | Zbl

[9] P. Cardaliaguet, Notes on P.L. Lions’ lectures at the College de France, Working Paper, September (2013).

[10] R. Carmona and F. Delarue, The Master equation for large population equilibriums, in Stochastic Analysis and Applications, edited by B. Hambly, D. Crisan, T. Zariphopoulou and M. Reizakis. Springer, Cham (2014) 77–128. | MR

[11] R. Carmona and F. Delarue, Probabilistic Theory of Mean Field Games with Applications. Springer Verlag (2017).

[12] R. Carmona, J.-P. Fouque and L.-H. Sun, Mean field games and systemic risk. Commun. Math. Sci. 13 (2015) 911–933. | DOI | MR | Zbl

[13] W. Gangbo and A. Święch, Existence of a solution to an equation arising from the theory of mean field games. J. Differ. Equ. 259 (2015) 6573–6643. | DOI | MR | Zbl

[14] R. Jordan, D. Kinderlehrer and F. Otto, The variational formulation of the Fokker-Planck equation. SIAM: J. Math.Anal. 29 (1998) 1–17. | MR | Zbl

[15] J.M. Lasry and P.L. Lions, Mean field games. Jpn. J. Math. 2 (2007) 229–260. | DOI | MR | Zbl

[16] M. Laurière, O. Pironneau, Dynamic programming for mean field type control. CRAS 352 (2014) 707–713. | MR | Zbl

[17] P.L. Lions, Lectures at College de France. Available at: http://www.college-de-france.fr.

[18] P.L. Lions, Seminar at College de France, November 14 (2014).

[19] F. Otto, The geometry of dissipative evolution equations: the porous medium equation. Commun. Partial Differ. Equ. 26 (2001) 101–174. | DOI | MR | Zbl

[20] C. Villani, Optimal Transport: Old and New. In Vol. 338 of Grundlehren der Mathematischen Wissenschaften. Springer, Berlin (2009). | MR | Zbl

Cité par Sources :