uncertainty quantification; stochastic modeling; representation of uncertainty; Monte Carlo; polynomial chaos; stochastic response surface method; stochastic sensitivity analysis
Abstract :
[en] In this paper, we offer a short overview of a number of methods that have been reported in the computational-mechanics literature for quantifying uncertainties in engineering applications. Within a probabilistic framework, we describe the characterization of uncertainties using mathematical statistics methods, the propagation of uncertainties through computational models using either Monte Carlo sampling or stochastic expansion methods, and the sensitivity analysis of uncertainties using variance- and differentiation-based methods. We restrict our attention to nonintrusive methods that can be implemented as wrappers around existing computer programs, thus requiring no modification of the source code. We include some recent advances in the propagation and sensitivity analysis of uncertainties that are characterized by arbitrary probability distributions that may exhibit statistical dependence. Finally, we demonstrate the methods integrated in the proposed overview through a nonlinear engineering application relevant to metal forming.
Disciplines :
Mechanical engineering
Author, co-author :
Arnst, Maarten ; Université de Liège - ULiège > Département d'aérospatiale et mécanique > Computational and stochastic modeling
Ponthot, Jean-Philippe ; Université de Liège - ULiège > Département d'aérospatiale et mécanique > LTAS-Mécanique numérique non linéaire
Language :
English
Title :
An overview of nonintrusive characterization, propagation, and sensitivity analysis of uncertainties in computational mechanics
Publication date :
2014
Journal title :
International Journal for Uncertainty Quantification
Hills, R., Pilch, M., Dowding, K., Red-Horse, J., Paez, T., Babuška, I., and Tempone, R., Validation challenge workshop, Compu, Methods Appl, Mech, Eng,, 197:29–32, 2008.
Capiez-Lernout, E. and Soize, C., Robust design optimization in computational mechanics, J. Appl. Mech. Trans. ASME, 75:0210011, 2008.
Higdon, D., Gattiker, J., Williams, B., and Rightley, M., Computer model calibration using high-dimensional output, J. Am. Stat. Assoc., 103:570–583, 2008.
Kree, P. and Soize, C., Mathematics of Random Phenomena, D. Reidel Publishing Company, Dordrecht, Netherlands, 1983.
Zhang, D., Stochastic Methods for Flow in Porous Media: Coping with Uncertainties, Academic Press, San Diego, California, 2001.
Ghanem, R. and Spanos, P., Stochastic Finite Elements: A Spectral Approach, Dover Publications, Mineola, New York, 2003.
Roberts, J. and Spanos, P., Random Vibration and Statistical Linearization, Dover Publications, Mineola, New York, 2003.
Batou, A. and Soize, C., Rigid multibody system dynamics with uncertain rigid bodies, Multibody System Dyn., 27:285–319, 2012.
Soize, C., Nonparametric model of random uncertainties for reduced matrix models in structural dynamics, Probab. Eng. Mech., 15:277–294, 2000.
Beck, J. and Katafygiotis, L., Updating models and their uncertainties. I: Bayesian statistical framework, J. Eng. Mech., 124:455–461, 1998.
Ljung, L., System Identification: Theory for the User, Prentice Hall, Upper Saddle River, New Jersey, 1998.
Kennedy, M. and O’Hagan, A., Bayesian calibration of computer models, J. R. Stat. Soc. Ser. B: Stat. Methodol., 63:425–450, 2001.
Soize, C., Generalized probabilistic approach of uncertainties in computational dynamics using random matrices and polynomial chaos decompositions, Int. J. Num. Methods Eng., 81:939–970, 2010.
Soize, C., Bayesian posteriors of uncertainty quantification in computational structural dynamics for low- and mediumfrequency ranges, Comput. Struct., 126:41–55, 2013.
McLachlan, G. and Peel, D., Finite Mixture Models, Wiley-Interscience, New York, 2000.
Kotz, S., Balakrishnan, N., and Johnson, N., Continuous Multivariate Distributions, Wiley-Interscience, New York, 2000.
Soize, C., Non-Gaussian positive-definite matrix-valued random fields for elliptic stochastic partial differential operators, Comput. Methods Appl. Mech. Eng., 195:26–64, 2006.
Desceliers, C., Ghanem, R., and Soize, C., Maximum likelihood estimation of stochastic chaos representations from experimental data, Int. J. Num. Methods Eng., 66:978–1001, 2006.
Ghanem, R. and Doostan, A., On the construction and analysis of stochastic models: Characterization and propagation of the errors associated with limited data, J. Comput. Phys., 217:63–81, 2006.
Arnst, M., Ghanem, R., and Soize, C., Identification of Bayesian posteriors for coefficients of chaos expansions, J. Comput. Phys., 229:3134–3154, 2010.
Soize, C., Identification of high-dimension polynomial chaos expansions with random coefficients for non-gaussian tensorvalued random fields using partial and limited experimental data, Comput. Methods Appl. Mech. Eng., 199:2150–2164, 2010.
Soize, C., A computational inverse method for identification of non-Gaussian random fields using the Bayesian approach in very high dimension, Comput. Methods Appl. Mech. Eng., 200:3083–3099, 2011.
Rosenblatt, M., Remarks on a multivariate transformation, Ann. Math, Stat,, 23:470–472, 1952.
Robert, C. and Casella, G., Monte Carlo Statistical Methods, Springer, New York, 2010.
Guilleminot, J. and Soize, C., On the statistical dependence for the components of random elasticity tensors exhibiting material symmetry properties, J. Elasticity, 2012.
Chebli, H. and Soize, C., Experimental validation of a nonparametric probabilistic model of nonhomogeneous uncertainties for dynamical systems, J. Acoust. Soc. Am., 115:697–705, 2004.
Mignolet, M. and Soize, C., Nonparametric stochastic modeling of linear systems with prescribed variance of several natural frequencies, Probab. Eng. Mech., 23:267–278, 2008.
Cottereau, R., Clouteau, D., and Soize, C., Construction of a probabilistic model for impedance matrices, Comput. Methods Appl. Mech. Eng., 196:2252–2268, 2007.
Ritto, T., Soize, C., and Sampaio, R., Non-linear dynamics of a drill-string with uncertain model of the bit-rock interaction, Int. J. Non-Linear Mech., 44:865–876, 2009.
Soize, C. and Poloskov, I., Time-domain formulation in computational mechanics for linear viscoelastic media with model uncertainties and stochastic excitation, Comput. Math. Appl., 64:3594–3612, 2012.
Mignolet, M., Soize, C., and Avalos, J., Nonparametric stochastic modeling of structures with uncertain boundary conditions/ coupling between substructures, AIAA J., 51:1296–1308, 2013.
Jaynes, E., Probability Theory The Logic of Science, Cambridge University Press, New York, 1987.
Wang, J. and Zabaras, N., A Bayesian inference approach to the inverse heat conduction problem, Int. J. Heat Mass Transfer, 47:3927–3941, 2004.
Marzouk, Y., Najm, H., and Rahn, L., Stochastic spectral methods for efficient Bayesian solution of inverse problems, J. Comput. Phys., 224:560–586, 2007.
Liu, W., Siad, L., Tian, R., Lee, S., Lee, D., Yin, X., Chen, W., Chan, S., Olson, G., Lindgen, L., Horstemeyer, M., Chang, Y., Choi, J., and Kim, Y., Complexity science of multiscale materials via stochastic computations, Int. J. Num. Methods Eng., 80:932–978, 2009.
Flath, H., Wilcox, L., Akçelik, V., Hill, J., Van Bloemen-Waanders, B., and Ghattas, O., Fast algorithms for Bayesian uncertainty quantification in large-scale linear inverse problems based on low-rank partial Hessian approximations, SIAM J. Scient. Comput., 33:407–432, 2011.
Berry, R., Najm, H., Debusschere, B., Marzouk, Y., and Adalsteinsson, H., Data-free inference of the joint distribution of uncertain model parameters, J. Comput. Phys., 231:2180–2198, 2012.
Schwab, C. and Stuart, A., Sparse deterministic approximation of Bayesian inverse problems, Inverse Probl., 28:045003, 2012.
Scott, D., Multivariate Density Estimation: Theory, Practice, and Visualization, Wiley, New York, 1992.
Cramèr, H., Mathematical Methods of Statistics, Princeton University Press, Princeton, New Jersey, 1997.
Ganapathysubramanian, B. and Zabaras, N., A non-linear dimension reduction methodology for generating data-driven stochastic input models, J. Comput. Phys., 227:6612–6637, 2008.
Soize, C., Construction of probability distributions in high dimension using the maximum entropy principle: Applications to stochastic processes, random fields and random matrices, Int. J. Num. Methods Eng., 76:1583–1611, 2008.
Casella, G. and Berger, R., Statistical Inference, Duxbury, Pacific Grove, California, 2002.
Dudley, R., Real Analysis and Probability, Cambridge University Press, Cambridge, United Kingdom, 2002.
Calfish, R., Monte Carlo and quasi-Monte Carlo methods, Acta Numer., 7:1–49, 1998.
Cliffe, K., Giles, M., Scheichl, R., and Teckentrup, A., Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients, Comput. Visualization Sci., 14:3–15, 2011.
Boyaval, S. and Lelièvre, T., A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm, Commun. Math. Sci., 8:735–762, 2010.
Bertsekas, D., Convex Analysis and Optimization, Athena Scientific, Belmont, Massachusetts, 2003.
Dunkl, C. and Xu, Y., Orthogonal Polynomials of Several Variables, Cambridge University Press, Cambridge, United Kingdom, 2001.
Ernst, O., Mugler, A., Starkloff, H., and Ullman, E., On the convergence of generalized polynomial chaos expansions, Math. Model. Num. Anal., 46:317–339, 2012.
Soize, C. and Ghanem, R., Physical systems with random uncertainties: Chaos representations with arbitrary probability measure, SIAM J. Sci. Comput., 26:395–410, 2004.
Matthies, H. and Keese, A., Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations, Comput. Methods Appl. Mech. Eng., 194:1295–1331, 2005.
Le Maître, O. and Knio, O., Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics, Springer, New York, 2010.
Xiu, D., Numerical Methods for Stochastic Computations: A Spectral Method Approach, Princeton University Press, Princeton, New Jersey, 2010.
Grigoriu, M., Stochastic Systems: Uncertainty Quantification and Propagation, Springer-Verlag, London, 2012.
Xiu, D., Efficient collocational approach for parametric uncertainty analysis, Commun. Comput. Phys., 2:293–309, 2007.
Ghanem, R., Hybrid stochastic finite elements and generalized Monte Carlo simulation, J. Appl. Mech., 65:1004–1009, 1998.
Ghanem, R. and Ghiocel, D., A new implementation of the spectral stochastic finite element method for stochastic constitutive relations, In Proc. of ASCE 12th Engineering Mechanics Conference, La Jolla, California, 1998.
Barthelmann, V., Novak, E., and Ritter, K., High dimensional polynomial interpolation on sparse grids, Adv. Comput. Math., 12:273–288, 2000.
Xiu, D. and Hesthaven, J., High-order collocation methods for differential equations with random inputs, SIAM J. Sci. Comput., 27:1118–1139, 2006.
Babuška, I., Nobile, F., and Tempone, R., A stochastic collocation method for elliptic partial differential equations with random input data, SIAM J. Num. Anal., 45:1005–1034, 2007.
Nobile, F., Tempone, R., and Webster, C., A sparse grid stochastic collocation method for partial differential equations with random input data, SIAM J. Num. Anal., 46:2309–2345, 2008.
Björck, A., Numerical Methods for Least Squares Problems, SIAM, Philadelphia Pennsylvania, 1996.
Golub, G. and Van Loan, C., Matrix Computations, The Johns Hopkins University Press, Baltimore, Maryland, 1996.
Nocedal, J. and Wright, S., Numerical Optimization, Springer, New York, New York, 2006.
Abramowitz, M. and Stegun, I., Handbook of Mathematical Functions: With Formulas, Graphs, and Mathematical Tables, Dover Publications, Mineola, New York, 1972.
Novak, E. and Ritter, K., Simple cubature formulas with high polynomial exactness, Constructive Approx., 15:499–522, 1999.
Davis, P. and Rabinowitz, P., Methods of Numerical Integration, Dover Publications, Mineola, New York, 2007.
Golub, G. and Meurant, G., Matrices, Moments and Quadrature with Applications, Princeton University Press, Princeton, New Jersey, 2009.
Holtz, M., Sparse Grid Quadrature in High Dimensions with Applications in Finance and Insurance, Springer, Berlin, Heidelberg, Germany, 2010.
Le Maître, O., Knio, O., Najm, H., and Ghanem, R., Uncertainty propagation using Wiener-Haar expansions, J. Comput. Phys., 197:28–57, 2004.
Le Maître, O., Najm, H., Ghanem, R., and Knio, O., Multi-resolution analysis of Wiener-type uncertainty propagation schemes, J. Comput. Phys., 197:502–531, 2004.
Ghosh, D., Ghanem, R., and Horse, J. R., Analysis of eigenvalues and modal interaction of stochastic systems, AIAA J., 43:2196–2201, 2005.
Wan, X. and Karniadakis, G., An adaptive multi-element generalized polynomial chaos method for stochastic differential equations, J. Comput. Phys., 209:617–642, 2005.
Chantrasmi, T., Doostan, A., and Iaccarino, G., Padè-Legendre approximants for uncertainty analysis with discontinuous response surfaces, J. Comput. Phys., 228:7159–7180, 2009.
Alexanderian, A., Le Maître, O., Najm, H., Iskandarani, M., and Knio, O., Multiscale stochastic preconditioners in non- intrusive spectral projection, J. Sci. Comput., 50:306–340, 2012.
Espig, M., Hackbusch, W., Litvinenko, A., Matthies, H., and Wähnert, P., Efficient low-rank approximation of the stochastic Galerkin matrix in tensor formats, Comput. Math. Appl., 2012.
Sacks, J., Schiller, S., and Welch, W., Designs for computer experiments, Technometrics, 31:41–47, 1989.
Nouy, A., A generalized spectral decomposition technique to solve a class of linear stochastic partial differential equations, Comput. Methods Appl. Mech. Eng., 196:4521–4537, 2007.
Bieri, M. and Schwab, C., Sparse high order FEM for elliptic sPDEs, Comput. Methods Appl. Mech. Eng., 198:1146–1170, 2009.
Doostan, A. and Owhadi, H., A non-adapted sparse approximation of PDEs with stochastic inputs, J. Comput. Phys., 230:3015–3034, 2011.
Jakeman, J., Archibald, R., and Xiu, D., Characterization of discontinuities in high-dimensional stochastic problems on adaptive sparse grids, J. Comput. Phys., 230:3977–3997, 2011.
Bilionis, I. and Zabaras, N., Multidimensional adaptive relevance vector machines for uncertainty quantification, SIAM J. Sci. Comput., 34:B881–B908, 2012.
Amsallem, D. and Farhat, C., Interpolation method for adapting reduced-order models and application to aeroelasticity, AIAA J., 46:1803–1813, 2008.
Degroote, J., Vierendeels, J., and Willcox, K., Interpolation among reduced-order matrices to obtain parameterized models for design, optimization and probabilistic analysis, Int. J. Num. Methods Fluids, 63:207–230, 2010.
Helton, J. and Davis, F., Sampling-based methods, Sensitivity Analysis, Saltelli, A., Chan, K., and Scott, E. (Eds.), pp. 101–153. Wiley, West Sussex, United Kingdom, 2000.
Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., Saisana, M., and Tarantola, S., Global Sensitivity Analysis: The Primer, Wiley, West Sussex, United Kingdom, 2008.
Lin, G. and Karniadakis, G., Sensitivity analysis and stochastic simulations of non-equilibrium plasma flow, Int. J. Num. Methods Eng., 80:738–766, 2009.
Sobol, I., Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simul., 55:271–280, 2001.
Oakley, J. and O’Hagan, A., Probabilistic sensitivity analysis of complex models: a Bayesian approach, J. R. Stat. Society. Ser. B, 66:751–769, 2004.
Kucherenko, S., Tarantola, S., and Annoni, P., Estimation of global sensitivity indices for models with dependent variables, Comput. Phys. Commun., 183:937–946, 2012.
Rubinstein, R., Sensitivity analysis and performance extrapolation for computer models, Operations Res., 37:72–81, 1989.
Pellissetti, M. and Ghanem, R., A method for the validation of predictive computations using a stochastic approach, ASME J. Offshore Mech. Arctic Eng., 126:227–234, 2004.
Reagan, M., Najm, H., Pèbay, P., Knio, O., and Ghanem, R., Quantifying uncertainty in chemical systems modeling, Int. J. Chem. Kinet., 37:368–382, 2005.
Millwater, H., Universal properties of kernel functions for probabilistic sensitivity analysis, Probab. Eng. Mech., 24:89–99, 2009.
Sudret, B., Global sensitivity analysis using polynomial chaos expansions, Reliab. Eng. Syst. Saf., 93:964–979, 2008.
Crestaux, T., Le Maître, O., and Martinez, J.-M., Polynomial chaos expansion for sensitivity analysis, Reliab. Eng. Syst. Saf., 94:1161–1172, 2009.
Eldred, M., Agarwal, H., Perez, V., Wojtkiewicz, S., and Renaud, J., Investigation of reliability method formulations in DAKOTA/UQ, Struct. Infrastruct. Eng., 3:199–213, 2007.
Cheung, S., Oliver, T., Prudencio, E., Prudhomme, S., and Moser, R., Bayesian uncertainty analysis with applications to turbulence modeling, Reliab. Eng. Syst. Saf., 96:1137–1149, 2011.
Heroux, M., Bartlett, R., Howle, V., Hoekstra, R., Hu, J., Kolda, T., Lehoucq, R., Long, K., Pawlowski, R., Phipps, E., Salinger, A., Thornquist, H., Tuminaro, R., Willenbring, J., Williams, A., and Stanley, K., An overview of the Trilinos project, ACM Trans. Math. Software, 31:397–423, 2005.
Debusschere, B., Najm, H., Pèbayt, P., Knio, O., Ghanem, R., and Le Maître, O., Numerical challenges in the use of polynomial chaos representations for stochastic processes, SIAM J. Sci. Comput., 26:698–719, 2005.
Papeleux, L. and Ponthot, J., Finite element simulation of springback in sheet metal forming, J. Mater. Process. Technol., 125–126:785–791, 2002.
Das, S., Ghanem, R., and Spall, J., Asymptotic sampling distribution for polynomial chaos representation from data: A maximum entropy and Fisher information approach, SIAM J. Sci. Comput., 30:2207–2234, 2007.
Wan, X. and Karniadakis, G., Beyond Wiener-Askey expansions: handling arbitrary PDFs, J. Sci. Comput., 27:455–464, 2006.
Witteveen, J. and Bijl, H., Modeling arbitrary uncertainties using Gram-Schmidt polynomial chaos, In Proc. of 44th AIAA Aerospace Sciences Meeting and Exhibit, Reno, Nevada, 2006.
Soize, C. and Desceliers, C., Computational aspects for constructing realizations of polynomial chaos in high dimension, SIAM J. Sci. Comput., 32:2820–2831, 2010.
Arnst, M., Ghanem, R., Phipps, E., and Red-Horse, J., Measure transformation and efficient quadrature in reduceddimensional stochastic modeling of coupled problems, Int. J. Numer. Methods Eng., 2012.
Perrin, G., Soize, C., and Funfschilling, C., Identification of polynomial chaos representations in high dimension from a set of realizations, SIAM J. Sci. Comput., 2012.
Moore, R., Algorithm AS 187: Derivatives of the incomplete gamma integral, J. R. Stat. Soc. Ser. C: Appl. Stat., 31:330–335, 1982.