We consider the problem of providing optimal uncertainty quantification (UQ) - and hence rigorous certification - for partially-observed functions. We present a UQ framework within which the observations may be small or large in number, and need not carry information about the probability distribution of the system in operation. The UQ objectives are posed as optimization problems, the solutions of which are optimal bounds on the quantities of interest; we consider two typical settings, namely parameter sensitivities (McDiarmid diameters) and output deviation (or failure) probabilities. The solutions of these optimization problems depend non-trivially (even non-monotonically and discontinuously) upon the specified legacy data. Furthermore, the extreme values are often determined by only a few members of the data set; in our principal physically-motivated example, the bounds are determined by just 2 out of 32 data points, and the remainder carry no information and could be neglected without changing the final answer. We propose an analogue of the simplex algorithm from linear programming that uses these observations to offer efficient and rigorous UQ for high-dimensional systems with high-cardinality legacy data. These findings suggest natural methods for selecting optimal (maximally informative) next experiments.
Mots-clés : uncertainty quantification, probability inequalities, non-convex optimization, Lipschitz functions, legacy data, point observations
@article{M2AN_2013__47_6_1657_0, author = {Sullivan, T. J. and McKerns, M. and Meyer, D. and Theil, F. and Owhadi, H. and Ortiz, M.}, title = {Optimal uncertainty quantification for legacy data observations of {Lipschitz} functions}, journal = {ESAIM: Mathematical Modelling and Numerical Analysis }, pages = {1657--1689}, publisher = {EDP-Sciences}, volume = {47}, number = {6}, year = {2013}, doi = {10.1051/m2an/2013083}, mrnumber = {3110491}, language = {en}, url = {http://www.numdam.org/articles/10.1051/m2an/2013083/} }
TY - JOUR AU - Sullivan, T. J. AU - McKerns, M. AU - Meyer, D. AU - Theil, F. AU - Owhadi, H. AU - Ortiz, M. TI - Optimal uncertainty quantification for legacy data observations of Lipschitz functions JO - ESAIM: Mathematical Modelling and Numerical Analysis PY - 2013 SP - 1657 EP - 1689 VL - 47 IS - 6 PB - EDP-Sciences UR - http://www.numdam.org/articles/10.1051/m2an/2013083/ DO - 10.1051/m2an/2013083 LA - en ID - M2AN_2013__47_6_1657_0 ER -
%0 Journal Article %A Sullivan, T. J. %A McKerns, M. %A Meyer, D. %A Theil, F. %A Owhadi, H. %A Ortiz, M. %T Optimal uncertainty quantification for legacy data observations of Lipschitz functions %J ESAIM: Mathematical Modelling and Numerical Analysis %D 2013 %P 1657-1689 %V 47 %N 6 %I EDP-Sciences %U http://www.numdam.org/articles/10.1051/m2an/2013083/ %R 10.1051/m2an/2013083 %G en %F M2AN_2013__47_6_1657_0
Sullivan, T. J.; McKerns, M.; Meyer, D.; Theil, F.; Owhadi, H.; Ortiz, M. Optimal uncertainty quantification for legacy data observations of Lipschitz functions. ESAIM: Mathematical Modelling and Numerical Analysis , Volume 47 (2013) no. 6, pp. 1657-1689. doi : 10.1051/m2an/2013083. http://www.numdam.org/articles/10.1051/m2an/2013083/
[1] T.J. Sullivan, Rigorous model-based uncertainty quantification with application to terminal ballistics. Part II: Systems with uncontrollable inputs and large scatter. J. Mech. Phys. Solids 60 (2011) 1002-1019.
, , , , , , , ,[2] Set-Valued Analysis, Modern Birkhäuser Classics, Birkhäuser Boston Inc., Boston, MA (2009), Reprint of the 1990 edition [MR1048347]. | MR | Zbl
and ,[3] Reliability of computational science. Numer. Methods Partial Differ. Eq. 23 (2007) 753-784. | MR | Zbl
, and ,[4] Mathematical Theory of Reliability, in vol. 17 of Classics in Applied Mathematics. Society Industrial and Applied Mathematics (SIAM), Philadelphia, PA (1996). With contributions by L. C. Hunter, Reprint of the 1965 original [MR 0195566]. | MR | Zbl
and ,[5] Optimal inequalities in probability theory: a convex optimization approach. SIAM J. Optim. 15 (2005) 780-804. | MR | Zbl
and ,[6] Convergence of Probability Measures, 2nd edn., Wiley Series in Probability and Statistics: Probability and Statistics. John Wiley and Sons Inc., New York (1999). http://dx.doi.org/10.1002/9780470316962. MR 1700749 (2000e:60008) | MR | Zbl
,[7] Convex Optimization. Cambridge University Press, Cambridge (2004). | MR | Zbl
and ,[8] Geometric Measure Theory, Die Grundlehren der Mathematischen Wissenschaften, Band 153. Springer-Verlag New York Inc., New York (1969). | MR | Zbl
,[9] The role of assumptions in statistical decisions. Proc. of the Third Berkeley Symposium on Mathematical Statistics and Probability, vol. I, 1954-1955 (Berkeley and Los Angeles). University of California Press (1956) 105-114. | MR | Zbl
,[10] Mathematical Programming Glossary, INFORMS Computing Society, http://glossary.computing.society.informs.org (2006). Originally authored by H. J. Greenberg, 1999-2006.
,[11] Six theorems about injective metric spaces, Comment. Math. Helv. 39 (1964), 65-76. | MR | Zbl
,[12] Lipschitzian optimization without the Lipschitz constant. J. Optim. Theory Appl. 79 (1993) 157-181. | MR | Zbl
, and ,[13] Rigorous model-based uncertainty quantification with application to terminal ballistics. Part I: Systems with controllable inputs and small scatter. J. Mech. Phys. Solids 60 (2011) 983-1001.
, , , , , , , and ,[14] Über die zusammenziehende und Lipschitzsche Transformationen. Fund. Math. 22 (1934) 77-108. | Zbl
,[15] How good is the simplex algorithm?, Inequalities, III, in Proc. Third Sympos. (Univ. California, Los Angeles, Calif., 1969; dedicated to the memory of Theodore S. Motzkin). Academic Press, New York (1972) 159-175. | MR | Zbl
and ,[16] Multi-objective optimization of problems with epistemic uncertainty, Evolutionary Multi-Criterion Optimization, in Lect. Notes Comput. Sci., of vol. 3410, edited by C.A. Coello Coello, A. Hernández Aguirre and E. Zitzler. Springer Berlin/Heidelberg (2005) 413-427. | Zbl
,[17] Rigorous verification, validation, uncertainty quantification and certification through concentration-of-measure inequalities. Comput. Methods Appl. Mech. Engrg. 197 (2008) 51-52, 4591-4609. | MR | Zbl
, and ,[18] On the method of bounded differences, Surveys in combinatorics, London Math. Soc. in vol. 141 of Lecture Note Ser. Cambridge Univ. Press, Cambridge (1989) 148-188. | MR | Zbl
,[19] Centering sequences with bounded differences, Combin. Probab. Comput. 6 (1997) 79-86, | MR | Zbl
,[20] Concentration, Probabilistic Methods for Algorithmic Discrete Mathematics. In vol. 16 of Algorithms Combin. Springer, Berlin (1998) 195-248. | MR | Zbl
,[21] Mystic: A simple model-independent inversion framework (2009).
, and ,[22] The optimal uncertainty algorithm in the mystic framework, Caltech CACR Technical Report, August 2010, available at http://arxiv.org/pdf/1202.1055v1.
, , , and ,[23] Building a framework for predictive science. Proc. of the 10th Python in Science Conference (SciPy 2011), edited by S. van der Walt and J. Millman (2011) 67-78. Available at http://jarrodmillman.com/scipy2011/pdfs/mckerns.pdf.
, , , and ,[24] Extension of range of functions. Bull. Amer. Math. Soc. 40 (1934) 837-842. | MR | Zbl
,[25] Optimal data split methodology for model validation, Proc. of World Congress on Engrg and Comput. Sci. (2011) vol. II, 1038-1043.
, , , and ,[26] Challenge problems: Uncertainty in system response given uncertain parameters. Reliab. Eng. Sys. Safety 85 (2004) 11-19.
, , , and ,[27] Verification, validation and predictive capability in computational engineering and physics. Appl. Mech. Rev. 57 (2004) 345-384.
, and ,[28] Optimal Uncertainty Quantification. SIAM Rev. To appear. | MR | Zbl
, , , and ,[29] Differential Evolution: A Practical Approach to Global Optimization, Natural Comput. Ser. Springer-Verlag, Berlin (2005). | MR | Zbl
, and ,[30] A complete framework for verification, validation and uncertainty quantification in scientific computing, 48th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition (2010). | MR
and ,[31] Radon Measures on Arbitrary Topological Spaces and Cylindrical Measures, Published for the Tata Institute of Fundamental Research, Bombay by Oxford University Press, London (1973). Tata Institute of Fundamental Research Studies in Mathematics, No. 6. | MR | Zbl
,[32] Limit theorems for stochastic processes, Teor. Veroyatnost. i Primenen. (Theor. Probab. Appl.) 1 (1956), 289-319. | MR | Zbl
,[33] Counterexamples in Topology, 2nd edn. Springer-Verlag, New York (1978). | MR | Zbl
and ,[34] Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11 (1997) 341-359. | MR | Zbl
and ,[35] Inverse problems: a Bayesian perspective. Acta Numer. 19 (2010) 451-559. | MR | Zbl
,[36] Uncertainty quantification via codimension-one partitioning. Int. J. Numer. Meth. Engng. 85 (2011) 1499-1521. | MR | Zbl
, , and ,[37] Concentration of measure and isoperimetric inequalities in product spaces. Inst. Hautes Études Sci. Publ. Math. (1995) 73-205. | Numdam | MR | Zbl
,[38] Rigorous uncertainty quantification without integral testing. Reliab. Eng. Sys. Safety 96 (2011) 1085-1091.
, , and ,[39] A Lipschitz condition preserving extension for a vector function. Amer. J. Math. 67 (1945) 83-93. | MR | Zbl
,[40] Concentration of non-Lipschitz functions and applications, Random Structures Algorithms 20 (2002) 262-316. | MR | Zbl
,[41] The product of Radon spaces, Uspekhi Mat. Nauk 35 (1980) 151-153, International Topology Conference (Moscow State Univ., Moscow, 1979), Translated from the English by A.V. Arhangel′skiĭ. | MR | Zbl
,Cited by Sources: