We study the mathematical modeling of the energy management system of a smart grid, related to a aggregated consumer equipped with renewable energy production (PV panels e.g.), storage facilities (batteries), and connected to the electrical public grid. He controls the use of the storage facilities in order to diminish the random fluctuations of his residual load on the public grid, so that intermittent renewable energy is better used leading globally to a much greener carbon footprint. The optimization problem is described in terms of an extended McKean-Vlasov stochastic control problem. Using the Pontryagin principle, we characterize the optimal storage control as solution of a certain McKean-Vlasov Forward Backward Stochastic Differential Equation (possibly with jumps), for which we prove existence and uniqueness. Quasi-explicit solutions are derived when the cost functions may not be linear-quadratic, using a perturbation approach. Numerical experiments support the study.
Keywords: Mean-field control, energy management, numerical methods for stochastic control
@article{COCV_2022__28_1_A40_0,
author = {Gobet, Emmanuel and Grangereau, Maxime},
title = {Extended {McKean-Vlasov} optimal stochastic control applied to smart grid management, },
journal = {ESAIM: Control, Optimisation and Calculus of Variations},
year = {2022},
publisher = {EDP-Sciences},
volume = {28},
doi = {10.1051/cocv/2022034},
mrnumber = {4445582},
zbl = {1497.93240},
language = {en},
url = {https://www.numdam.org/articles/10.1051/cocv/2022034/}
}
TY - JOUR AU - Gobet, Emmanuel AU - Grangereau, Maxime TI - Extended McKean-Vlasov optimal stochastic control applied to smart grid management, JO - ESAIM: Control, Optimisation and Calculus of Variations PY - 2022 VL - 28 PB - EDP-Sciences UR - https://www.numdam.org/articles/10.1051/cocv/2022034/ DO - 10.1051/cocv/2022034 LA - en ID - COCV_2022__28_1_A40_0 ER -
%0 Journal Article %A Gobet, Emmanuel %A Grangereau, Maxime %T Extended McKean-Vlasov optimal stochastic control applied to smart grid management, %J ESAIM: Control, Optimisation and Calculus of Variations %D 2022 %V 28 %I EDP-Sciences %U https://www.numdam.org/articles/10.1051/cocv/2022034/ %R 10.1051/cocv/2022034 %G en %F COCV_2022__28_1_A40_0
Gobet, Emmanuel; Grangereau, Maxime. Extended McKean-Vlasov optimal stochastic control applied to smart grid management,. ESAIM: Control, Optimisation and Calculus of Variations, Tome 28 (2022), article no. 40. doi: 10.1051/cocv/2022034
[1] , and , Extended mean field control problems: stochastic maximum principle and transport perspective. SIAM J. Control Optim. 57 (2019) 3666–3693. | MR | Zbl | DOI
[2] , and , An extended mean field game for storage in smart grids. J. Optim. Theory Appl. 184 (2020) 644–670. | MR | Zbl | DOI
[3] , , , , and , Cemracs 2017: numerical probabilistic approach to MFG. ESAIM: PS 65 (2019) 84–113. | MR | Zbl | DOI
[4] , , and , Day-ahead probabilistic forecast of solar irradiance: a Stochastic Differential Equation approach. Renewable Energy: Forecasting and Risk Management. Edited by , , , and , Springer Proceedings in Mathematics & Statistics (2018) 73–93.
[5] and , A weak martingale approach to linear-quadratic McKean–Vlasov stochastic control problems. J. Optim. Theory Appl. 181 (2019) 347–382. | MR | Zbl | DOI
[6] , , and , Generalized quantiles as risk measures. Insurance: Math. Econ. 54 (2014) 41–48. | MR | Zbl
[7] , Perturbation methods in optimal control. Wiley/Gauthier-Villars Series in Modern Applied Mathematics. Translated from the French by . John Wiley & Sons Ltd., Chichester (1988). | MR | Zbl
[8] , and , Diffusion-type models with given marginal distribution and autocorrelation function. Bernoulli 11 (2005) 191–220. | MR | Zbl
[9] , Functional analysis, Sobolev spaces and partial differential equations. Springer Science+Business Media (2010). | MR
[10] and , Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics. Ann. Probab. 43 (2015) 2647–2700. | MR | Zbl | DOI
[11] and , Probabilistic Theory of Mean Field Games with Applications I-II. Springer (2018). | MR | Zbl
[12] , , and , Algorithms for two-time scales stochastic optimization with applications to long term management of energy storage. HAL preprint hal-02013969 (2019).
[13] and , Weak existence and uniqueness for forward-backward SDEs. Stoch. Process. Appl. 116 (2006) 1712–1742. | MR | Zbl | DOI
[14] , and , Backward stochastic differential equations in finance. Math. Finance 7 (1997) 1–71. | MR | Zbl | DOI
[15] , , , , and , Continuous optimal control approaches to microgrid energy management. Energy Syst. 9 (2018) 59–77. | DOI
[16] , , and , A stochastic continuous time model for microgrid energy management. In Control Conference (ECC), 2016 European. IEEE (2016) 2084–2089. | DOI
[17] , , and , Modeling of sodium sulfur battery for power system applications. Elektrika J. Electr. Eng. 9 (2007) 66–72.
[18] , and , Optimal charging of an electric vehicle using a Markov decision process. Appl. Energy 123 (2014) 1–12. | DOI
[19] , , , and , Integrating renewables in electricity markets. Vol. 205 of International Series in Operations Research & Management Science. Springer Science + Business Media, New York (2014). | MR
[20] , , and , Stochastic optimal control of a domestic microgrid equipped with solar panel and battery. Preprint (2018). | arXiv | Zbl
[21] and , Forward-backward stochastic differential equations and quasilinear parabolic PDEs. Probab. Theory Relat. Fields 114 (1999) 123–150. | MR | Zbl | DOI
[22] , A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28 (1990) 966–979. | MR | Zbl | DOI
[23] and , Discrete time McKean–Vlasov control problem: a dynamic programming approach. Appl. Math. Optim. 74 (2016) 487–506. | MR | Zbl | DOI
[24] and , Bellman equation and viscosity solutions for mean-field stochastic control problem. ESAIM: COCV 24 (2018) 437–461. | MR | Zbl | Numdam
[25] , Stochastic Integration and Differential Equations. Springer Berlin Heidelberg, Berlin, Heidelberg, second edition (2003).
[26] , and , Nonlinear predictive energy management of residential buildings with photovoltaics & batteries. J. Power Sources 325 (2016) 723–731. | DOI
[27] , , and , Advanced control of thermostatic loads for rapid frequency response in great Britain. IEEE Trans. Power Syst. 32 (2016) 2106–2117. | DOI
[28] , and , Leaky storage model for optimal multi-service allocation of thermostatic loads. IET Gener. Trans. Distrib. 10 (2016) 585–593. | DOI
[29] , , , and , Stochastic control of smart home energy management with plug-in electric vehicle battery energy storage and photovoltaic array. J. Power Sources 333 (2016) 203–212. | DOI
[30] , Linear forward-backward stochastic differential equations with random coefficients. Prob. Theory Related Fields 135 (2006) 53–83. | MR | Zbl | DOI
[31] , Linear-quadratic optimal control problems for mean-field stochastic differential equations. SIAM J. Control Optim. 51 (2013) 2809–2838. | MR | Zbl | DOI
Cité par Sources :
This work has benefited from several supports: Siebel Energy Institute (Calls for Proposals #2, 2016), ANR project CAESARS (ANR-15-CE05-0024), Association Nationale de la Recherche Technique (ANRT), Electricité De France (EDF), Finance for Energy Market (FiME) Lab (Institut Europlace de Finance), Chair “Stress Test, RISK Management and Financial Steering” of the Foundation Ecole Polytechnique.
This work has been presented at the FOREWER conference Paris-June 2017, at the MCM2017 conference Montreal-July 2017, at the conference “Stochastic control, BSDEs and new developments” Roscoff-September 2017, at the conference “Advances in Stochastic Analysis for Risk Modeling” CIRM-November 2017, at the Workshop “Mean-Field Games, Energy and Environment” London-February 2018, at the conference “Advances in Modelling and Control for Power Systems of the Future” Paris-September 2018, at the conference “APS Informs” Brisbane-July 2019, at the MCM2019 conference Sydney-July 2019. The authors wish to thank the participants for their feedbacks.
