This paper is concerned with two-person mean-field linear-quadratic non-zero sum stochastic differential games in an infinite horizon. Both open-loop and closed-loop Nash equilibria are introduced. The existence of an open-loop Nash equilibrium is characterized by the solvability of a system of mean-field forward-backward stochastic differential equations in an infinite horizon and the convexity of the cost functionals, and the closed-loop representation of an open-loop Nash equilibrium is given through the solution to a system of two coupled non-symmetric algebraic Riccati equations. The existence of a closed-loop Nash equilibrium is characterized by the solvability of a system of two coupled symmetric algebraic Riccati equations. Two-person mean-field linear-quadratic zero-sum stochastic differential games in an infinite horizon are also considered. Both the existence of open-loop and closed-loop saddle points are characterized by the solvability of a system of two coupled generalized algebraic Riccati equations with static stabilizing solutions. Mean-field linear-quadratic stochastic optimal control problems in an infinite horizon are discussed as well, for which it is proved that the open-loop solvability and closed-loop solvability are equivalent.
Keywords: Two-person mean-field linear-quadratic stochastic differential game, infinite horizon, open-loop and closed-loop Nash equilibria, algebraic Riccati equations, MF-$$2-stabilizability, static stabilizing solution
@article{COCV_2021__27_1_A83_0,
author = {Li, Xun and Shi, Jingtao and Yong, Jiongmin},
title = {Mean-field linear-quadratic stochastic differential games in an infinite horizon},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
year = {2021},
publisher = {EDP-Sciences},
volume = {27},
doi = {10.1051/cocv/2021078},
language = {en},
url = {https://www.numdam.org/articles/10.1051/cocv/2021078/}
}
TY - JOUR AU - Li, Xun AU - Shi, Jingtao AU - Yong, Jiongmin TI - Mean-field linear-quadratic stochastic differential games in an infinite horizon JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2021 VL - 27 PB - EDP-Sciences UR - https://www.numdam.org/articles/10.1051/cocv/2021078/ DO - 10.1051/cocv/2021078 LA - en ID - COCV_2021__27_1_A83_0 ER -
%0 Journal Article %A Li, Xun %A Shi, Jingtao %A Yong, Jiongmin %T Mean-field linear-quadratic stochastic differential games in an infinite horizon %J ESAIM: Control, Optimisation and Calculus of Variations %D 2021 %V 27 %I EDP-Sciences %U https://www.numdam.org/articles/10.1051/cocv/2021078/ %R 10.1051/cocv/2021078 %G en %F COCV_2021__27_1_A83_0
Li, Xun; Shi, Jingtao; Yong, Jiongmin. Mean-field linear-quadratic stochastic differential games in an infinite horizon. ESAIM: Control, Optimisation and Calculus of Variations, Tome 27 (2021), article no. 81. doi: 10.1051/cocv/2021078
[1] and , Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls. IEEE Trans. Automat. Control 45 (2000) 1131–1143.
[2] , and , Well-posedness and attainability of indifinite stochastic linear quadratic control in infinite time horizon. Syst. Control Lett. 41 (2000) 123–133.
[3] and , Controlled McKean-Vlasov equations. Commun. Appl. Anal. 5 (2001) 183–206.
[4] and , A maximum principle for stochastic control of SDE’s of mean-field type. Appl. Math. Optim. 63 (2011) 341–356.
[5] and , Optimal Control: Linear Quadratic Methods. Prentice Hall, Englewood Cliffs, NJ (1989).
[6] , and , Mean field games and mean field type control theory. Springer, New York (2013).
[7] , and , Linear-quadratic time-inconsistent mean-field games. Dyn. Games Appl. 3 (2013) 537–552.
[8] , , and , Linear-quadratic mean-field games. J. Optim. Theory Appl. 169 (2016) 496–529.
[9] , and , Well-posedness of mean-field type forward-backward stochastic differential equations. Stoch. Proc. Appl. 125 (2015) 3327–3354.
[10] , and , A general stochastic maximum principle for SDEs of mean-field type. Appl. Math. Optim. 64 (2011) 197–216.
[11] , and , A stochastic maximum principle for general mean-field systems. Appl. Math. Optim. 74 (2016) 507–534.
[12] , and , A mean-field stochastic control problem with partial observations. Ann. Probab. 27 (2017) 3201–3245.
[13] , and , Mean-field backward stochastic differential equations and related partial differential equations. Stoch. Proc. Appl. 119 (2009) 3113–3154.
[14] , , and , Mean-field stochastic differential equations and associated PDEs. Ann. Probab. 45 (2017) 824–878.
[15] and , Mean field forward-backward stochastic differential equations. Electr. Commun. Probab. 18 (2013) 1–15.
[16] and , Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics. Ann. Probab. 43 (2015) 2647–2700.
[17] , Dynamics of the McKean-Vlasov equation. Ann. Probab. 22 (1994) 431–441.
[18] and , Nash equilibria for nonzero-sum ergodic stochastic differential games. J. Appl. Probab. 54 (2017) 977–994.
[19] and , A characterization of sub-game perfect equilibria for SDEs of mean-field type. Dyn. Games. Appl. 6 (2016) 55–81.
[20] , and , A stochastic maximum principle for risk-sensitive mean-field type control. IEEE Trans. Autom. Control 60 (2015) 2640–2649.
[21] , A stochsastic maximum principle for a stochastic differential game of a mean-field type. Appl. Math. Optim. 66 (2012) 415–454.
[22] , and , Mean-field linear-quadratic-Gaussian (LQG) games for stochastic integral systems. IEEE Trans. Autom. Control 61 (2016) 2670–2675.
[23] , , and , A linear-quadratic optimal control problem for mean-field stochastic differential equations in infinite horizon. Math. Control Rel. Fields 5 (2015) 97–139.
[24] , and , Large population stochastic dynamic games: Closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst. 6 (2006) 221–251.
[25] , Foundations of kinetic theory. Proc. Third Berkeley Symp. Math. Stat. Probab. 3 (1956) 171–197.
[26] and , Mean field games. Jpn. J. Math. 2 (2007) 229–260.
[27] , Stochastic maximum principle in the mean-field controls. Automatica 48 (2012) 366–373.
[28] , and , Indefinite mean-field type linear-quadratic stochastic optimal control problems. Automatica 122 (2020) 109267.
[29] , and , Mean-field linear-quadratic stochastic differential games in an infinite horizon. | arXiv
[30] , and , Linear quadratic optimal control problems for mean-field backward stochastic differential equations. Appl. Math. Optim. 80 (2018) 223–250.
[31] , and , Mean-field stochastic linear quadratic optimal control problems: closed-loop solvability. Probab. Uncer. & Quan. Risk 1 (2016) 1–24.
[32] , A class of Markov processes associated with nonlinear parabolic equations. Proc. Natl. Acad. Sci. USA 56 (1966) 1907–1911.
[33] , , and , A mean-field stochastic maximum principle via Malliavin calculus. Stochastics 84 (2012) 643–666.
[34] and , Linear-quadratic McKean-Vlasov stochastic differential games, in vol. 164 of Modeling, Stochastic Control, Optimization, and Applications, IMA Vol. Math. Appl., edited by and . Springer Nature, Switzerland (2019) 451–481.
[35] , Linear-quadratic mean-field stochastic zero-sum differential games. Automatica 120 (2020) 109067.
[36] and , Two-person zero-sum linear quadratic stochastic differential games by a Hilbert space method. J. Indu. Mana. Optim. 2 (2006) 93–115.
[37] and , Dynamic programming for optimal control of stochastic McKean-Vlasov dynamics. SIAM J. Control Optim. 55 (2017) 1069–1101.
[38] and , Bellman equation and viscosity solutions for mean-field stochastic control problem. ESAIM: COCV 24 (2018) 437–461.
[39] , A generalized inverse of matrices. Proc. Cambr. Philos. Soc. 52 (1955) 17–19.
[40] , Uniqueness and non-uniqueness of solutions of Vlasov-McKean equations. J. Aust. Math. Soc., Ser. A 43 (1987) 246–256.
[41] , Mean-field stochastic linear quadratic optimal control problems: Open-loop solvabilities. ESAIM: COCV 23 (2017) 1099–1127.
[42] , Two-person zero-sum stochastic linear-quadratic differential games. | arXiv
[43] , and , Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems. SIAM J. Control Optim. 54 (2016) 2274–2308.
[44] , and , Mean-field linear-quadratic stochastic differential games. | arXiv
[45] and , Linear quadratic stochastic differential games: Open-loop and closed-loop saddle points. SIAM J. Control Optim. 52 (2014) 4082–4121.
[46] and , Stochastic linear quadratic optimal control problems in infinite horizon. Appl. Math. Optim. 78 (2018) 145–183.
[47] and , Linear quadratic stochastic two-person nonzero-sum differential games: Open-loop and closed-loop Nash equilibria. Stoch. Proc. Appl. 129 (2019) 381–418.
[48] and , Stochastic Linear-Quadratic Optiml Control Theory: Open-Loop and Closed-Loop Solutions. Springer (2020).
[49] and , Stochastic Linear-Quadratic Optiml Control Theory: Differential Games and Mean-Field Problems. Springer (2020).
[50] , and , Linear quadratic stochastic two-person zero-sum differential games in an infinite horizon. ESAIM: COCV 22 (2016) 743–769.
[51] , and , A closed-loop saddle point for zero-sum linear-quadratic stochastic differential games with mean-field type. Syst. Control Lett. 136 (2020) 104624.
[52] , A leader-follower stochastic linear quadratic differential games. SIAM J. Control Optim. 41 (2002) 1015–1041.
[53] , A linear-quadratic optimal control problem for mean-field stochastic differential equations. SIAM J. Control Optim. 51 (2013) 2809–2838.
[54] , Linear-quadratic optimal control problems for mean-field stochastic differential equations—time-consistent solutions. Trans. Amer. Math. Soc. 369 (2017) 5467–5523.
[55] , An optimal feedback control-strategy pair for zero-sum linear-quadratic stochastic differential game: the Riccati equation approach. SIAM J. Control Optim. 55 (2015) 2141–2167.
Cité par Sources :
This work was financially supported by Research Grants Council of Hong Kong under Grant 15213218 and 15215319, National Key R&D Program of China under Grant 2018YFB1305400, National Natural Science Funds of China under Grant 11971266, 11831010 and 11571205, China Scholarship Council, Shandong Provincial Natural Science Foundations under Grant ZR2020ZD24 and ZR2019ZD42, and NSF Grant DMS-1812921.
