In this paper, we investigate a class of infinite-horizon optimal control problems for stochastic differential equations with delays for which the associated second order Hamilton−Jacobi−Bellman (HJB) equation is a nonlinear partial differential equation with delays. We propose a new concept for the viscosity solution including time t and identify the value function of the optimal control problems as a unique viscosity solution to the associated second order HJB equation.
Keywords: Second order Hamilton−Jacobi−Bellman equation, viscosity solution, infinite-horizon optimal control, stochastic differential equations with delays, existence and uniqueness
Zhou, Jianjun 1
@article{COCV_2018__24_2_639_0,
author = {Zhou, Jianjun},
title = {A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated {HJB} equation},
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
pages = {639--676},
year = {2018},
publisher = {EDP Sciences},
volume = {24},
number = {2},
doi = {10.1051/cocv/2017042},
mrnumber = {3816408},
zbl = {1401.93234},
language = {en},
url = {https://www.numdam.org/articles/10.1051/cocv/2017042/}
}
TY - JOUR AU - Zhou, Jianjun TI - A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2018 SP - 639 EP - 676 VL - 24 IS - 2 PB - EDP Sciences UR - https://www.numdam.org/articles/10.1051/cocv/2017042/ DO - 10.1051/cocv/2017042 LA - en ID - COCV_2018__24_2_639_0 ER -
%0 Journal Article %A Zhou, Jianjun %T A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation %J ESAIM: Control, Optimisation and Calculus of Variations %D 2018 %P 639-676 %V 24 %N 2 %I EDP Sciences %U https://www.numdam.org/articles/10.1051/cocv/2017042/ %R 10.1051/cocv/2017042 %G en %F COCV_2018__24_2_639_0
Zhou, Jianjun. A class of infinite-horizon stochastic delay optimal control problems and a viscosity solution to the associated HJB equation. ESAIM: Control, Optimisation and Calculus of Variations, Tome 24 (2018) no. 2, pp. 639-676. doi: 10.1051/cocv/2017042
[1] , , and , A maximum principle for infinite horizon delay equations. SIAM J. Math. Anal. 45 (2013) 2499–2522 | MR | Zbl | DOI
[2] and , Semigroups for Delay Equations, in vol. 10 of Res. Notes Math., edited by , Ltd., Wellesley, MA (2005) | MR | Zbl
[3] , , and , Representation and control of infinite dimensional systems, Birkhauser, Boston (1993) | MR | Zbl | DOI
[4] , , Classics in Applied Mathematics. SIAM (1992) | MR | Zbl
[5] and , Hamilton–Jacobi–Bellman equations for the optimal control of a state equation with memory. ESAIM: COCV 16 (2010) 744–763 | MR | Zbl | Numdam
[6] , and , A stochastic portfolio optimization model with bounded memory. Math. Operat. Res. 36 (2011) 604–619 | MR | Zbl | DOI
[7] and , Maximum principle for the stochastic optimal control problem with delay and application.Automatica 46 (2010) 1074–1080 | MR | Zbl | DOI
[8] , and , Users guide to viscosity solutions of second order partial differential equations. Bull. Amer. Math. Soc. 27 (1992) 1–67 | MR | Zbl | DOI
[9] , and , Some solvable stochastic control problems with delay. Stochastics Stochastics Rep. 71 (2000) 69–89 | MR | Zbl | DOI
[10] , and , HJB equations for the optimal control of differential equations with delays and state constraints, I: regularity of viscosity solutions. SIAM J. Control Optimiz. 48 (2010) 4910–4937 | MR | Zbl | DOI
[11] , A stochastic control problem with delay arising in a pension fund model. Finance and Stochastics 15 (2011) 421–459 | MR | Zbl | DOI
[12] and , Infinite horizon backward stochasticdifferential equations and elliptic equations in Hilbert spaces. Ann. Probab. 32 (2004) 607–660 | MR | Zbl | DOI
[13] , and , Stochastic equations with delay: optimal control via BSDEs and regular solutions of Hamilton–Jacobi–Bellman equations. SIAM J. Control Optimiz. 48 (2010) 4624–4651 | MR | Zbl | DOI
[14] and , Fair demographic risk sharing in defined contribution pension systems. J. Econ. Dynamics Control 36 (2012) 657–669 | MR | Zbl | DOI
[15] and , Stochastic optimal control of delay equations arising in advertising models, Stochastic partial differential equations and applications, edited by and (2005) | MR | Zbl
[16] and , Stochastic Optimal Control of Delay Equations arising in Advertising Models, SPDE and Applications, edited by and (2006) 133–148 | MR | Zbl
[17] , and , On controlled linear diffusions with delay in a model of optimal advertising under uncertainty with memory effects. J. Optimiz. Theory Appl. 142 (2009) 291–321 | MR | Zbl | DOI
[18] , and , Second order Hamilton-Jacobi equations in Hilbert spaces andstochastic boundary control. SIAM J. Control Optim.38 (2000) 400–430 | MR | Zbl | DOI
[19] and , Control of systems with aftereffect, American Mathematical Society, Translations of Math. Monograph 157 (1996) | MR | Zbl
[20] , Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. I. The case of bounded stochastic evolutions. Acta Math. 161 (1988) 243–78 | MR | Zbl | DOI
[21] , Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. II. Optimal control of Zakai’s equation. in: Stochastic partial differential equations and applications, II, edited by , . Lect. Notes Math. In vol. 1390. Springer (1989) 147–170 | MR | Zbl | DOI
[22] , Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III. Uniqueness of viscosity solutions for general second-order equations. J. Funct. Anal. 86 (1989) 1–18 | MR | Zbl | DOI
[23] , Stochastic Functional Differential Equations. Res. Notes Math. Pitman, Boston, MA 99 (1984) | MR | Zbl
[24] , , An optimal portfolio model with stochastic volatility and stochastic interest rate. J. Math. Anal. Appl. 375 (2011) 510–522 | MR | Zbl | DOI
[25] and , A maximum principle for optimal control of stochastic systems with delay with applications to finance, Optimal Control and PDE, Essays in Honour of Alain Bensoussan, edited by , and IOS Press, Amsterdam (2001) 64–79 | MR | Zbl
[26] , and , Optimal control of stochastic delay equations and time advanced backward stochastic differential equations. Adv. Appl. Probab. 43 (2011) 572–596 | MR | Zbl | DOI
[27] , Portfolio optimization models on infinite time horizon. J. Optimiz. Theory and Appl. 122 (2004) 573–597 | MR | Zbl | DOI
[28] , Stochastic portfolio optimization with log utility. Int. J. Theor. Appl. Finance 9 (2006) 869–887 | MR | Zbl | DOI
[29] and , An application of functional Its formula to stochastic portfolio optimization with bounded memory, Proceedingsof 2015 SIAM Conference on Control and Its Applications (CT15) 8–10, Paris, France 159–166 (2015) | DOI
[30] and , Optimal investment and consumption for a portfolio with stochastic dividends, www4.ncsu.edu
[31] and , Stochastic Equations in Infinite Dimensions, vol. 44 of Encyclopedia of Mathematics and its Applications. Cambridge University Press, Cambridge (1992) | MR | Zbl
[32] , “Unbounded” second order partial differential equations in infinite-dimensional Hilbertspaces. Commun. Partial Differ. Equ. 19 (1994) 11–12, 1999–2036 | MR | Zbl
[33] , Measure theory handouts, Science Press, Beijing (2004)
[34] and , Optimal control problems for stochastic delay evolution equations in Banach spaces. Inter. J. Control 84 (2011) 1295–1309 | MR | Zbl | DOI
[35] and , The existence and uniqueness of the solution for nonlinear Kolmogorov equations. J. Differ. Equ. 253 (2012) 2873–2915 | MR | Zbl | DOI
[36] J. Zhou, A Class of Delay Optimal Control Problems and ViscositySolutions toAssociatedHamilton−Jacobi−Bellman Equations, preprint available at: | arXiv
Cité par Sources :
