Abstract
Optimal experimental design (OED) aims to maximize the value of experiments and the data they produce. OED ensures efficient allocation of limited resources, especially when numerous repeated experiments cannot be performed. This chapter presents a fully Bayesian and decision theoretic approach to OED—accounting for uncertainties in models, model parameters, and experimental outcomes, and allowing optimality to be defined according to a range of possible experimental goals. We demonstrate this approach on two illustrative problems in materials research. The first example is a parameter inference problem. Its goal is to determine a substrate property from the behavior of a film deposited thereon. We design experiments to yield maximal information about the substrate property using only two measurements. The second example is a model selection problem. We design an experiment that optimally distinguishes between two models for helium trapping at interfaces. In both instances, we provide model-based justifications for why the selected experiments are optimal. Moreover, both examples illustrate the utility of reduced-order or surrogate models in optimal experimental design.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
A nat is a unit of information, analogous to a bit, but with a natural logarithm rather than a base two logarithm in (2.5).
References
B.L. Adams, S.R. Kalidindi, D.T. Fullwood, Microstructure Sensitive Design for Performance Optimization (Butterworth-Heineman, Newton, 2012)
R. Aggarwal, M. Demkowicz, Y. Marzouk, Bayesian inference of substrate properties from film behavior. Model. Simul. Mater. Sci. Eng. 23, 015009 (2015)
J. Aizenberg, A. Black, G. Whitesides, Controlling local disorder in self-assembled monolayers by patterning the topography of their metallic supports. Nature 394, 868–871 (1998)
S. Atamturktur, J. Hegenderfer, B. Williams, C. Unal, Selection criterion based on an exploration-exploitation approach for optimal design of experiments. J. Eng. Mech. 141 (2014)
A.C. Atkinson, A.N. Donev, Optimum Experimental Designs, Oxford Statistical Science Series (Oxford University Press, Oxford, 1992)
G. Bayraksan, D.P. Morton, Assessing solution quality in stochastic programs via sampling. INFORMS Tutor. Oper. Res. 5, 102–122 (2009)
I. Ben-Gal, M. Caramanis, Sequential doe via dynamic programming. IIE Trans. 34, 1087–1100 (2002)
J. Berger, L. Pericchi, Objective Bayesian methods for model selection: introduction and comparison, in Model Selection, IMS Lecture Notes—Monograph Series, ed. by P. Lahiri (2001), pp. 135–207
D.P. Bertsekas, Dynamic Programming and Optimal Control, 3rd edn. (Athena Scientific, Belmont, 2007)
I. Beyerlein, M. Demkowicz, A. Misra, B. Uberuaga, Defect-interface interactions. Progr. Mater. Sci. (2015)
D. Bhattacharyya, N. Mara, P. Dickerson, R. Hoagland, A. Misra, Transmission electron microscopy study of the deformation behavior of Cu/Nb and Cu/Ni nanoscale multilayers during nanoindentation. J. Mater. Res. 24, 1291–1302 (2009)
D. Bhattacharyya, N. Mara, P. Dickerson, R. Hoagland, A. Misra, Compressive flow behavior of Al-TiN multilayers at nanometer scale layer thickness. Acta Mater. 59, 3804–3816 (2011)
W. Bollmann, Crystal Defects and Crystalline Interfaces (Springer, Berlin, 1970)
N. Bowden, S. Brittain, A. Evans, J. Hutchinson, G. Whitesides, Spontaneous formation of ordered structures in thin films of metals supported on an elastomeric polymer. Nature 393, 146–149 (1998)
G.E.P. Box, H.L. Lucas, Design of experiments in non-linear situations. Biometrika 46, 77–90 (1959)
T. Bui-Thanh, O. Ghattas, J. Martin, G. Stadler, A computational framework for infinite-dimensional Bayesian inverse problems part I: the linearized case, with application to global seismic inversion. SIAM J. Sci. Comput. 35, A2494–A2523 (2013)
T. Bui-Thanh, K. Willcox, O. Ghattas, Model reduction for large-scale systems with high-dimensional parametric input space. SIAM J. Sci. Comput. 30, 3270–3288 (2008)
J. Cahn, J. Hilliard, Free energy of a nonuniform system. I. Interfacial free energy. J. Chem. Phys. 28, 258–267 (1958)
P.R. Cantwell, M. Tang, S.J. Dillon, J. Luo, G.S. Rohrer, M.P. Harmer, Grain boundary complexions. Acta Mater. 62, 1–48 (2014)
B.P. Carlin, J.B. Kadane, A.E. Gelfand, Approaches for optimal sequential decision analysis in clinical trials. Biometrics, pp. 964–975 (1998)
K. Chaloner, I. Verdinelli, Bayesian experimental design: a review. Stat. Sci. 10, 273–304 (1995)
S. Chaturantabut, D.C. Sorensen, Nonlinear model reduction via discrete empirical interpolation. SIAM J. Sci. Comput. 32, 2737–2764 (2010)
J.A. Christen, C. Fox, MCMC using an approximation. J. Comput. Graph. Stat. 14, 795–810 (2005)
P. Conrad, Y.M. Marzouk, Adaptive Smolyak pseudospectral approximations. SIAM J. Sci. Comput. 35, A2643–A2670 (2013)
P. Conrad, Y.M. Marzouk, N. Pillai, A. Smith, Accelerating asymptotically exact MCMC for computationally intensive models via local approximations. J. Am. Stat. Assoc. submitted (2014). arXiv:1402.1694
T.M. Cover, J.A. Thomas, Elements of Information Theory, 2nd edn. (Wiley, Hoboken, 2006)
T. Cui, Y.M. Marzouk, K. Willcox, Data-driven model reduction for the Bayesian solution of inverse problems. Int. J. Numer. Methods Eng. 102, 966–990 (2015)
S. Davis et al., Bayesian inference as a tool for analysis of first-principles calculations of complex materials: an application to the melting point of ti2gan. Model. Simul. Mater. Sci. Eng. 21, 075001 (2013)
M. Demkowicz, D. Bhattacharyya, I. Usov, Y. Wang, M. Nastasi, A. Misra, The effect of excess atomic volume on he bubble formation at fcc-bcc interfaces. Appl. Phys. Lett. 97, 161903–161903 (2010)
M. Demkowicz, R. Hoagland, Structure of kurdjumov-sachs interfaces in simulations of a copper-niobium bilayer. J. Nucl. Mater. 372, 45–52 (2008)
M. Demkowicz, R. Hoagland, B. Uberuaga, A. Misra, Influence of interface sink strength on the reduction of radiation-induced defect concentrations and fluxes in materials with large interface area per unit volume. Phys. Rev. B 84, 104102 (2011)
M. Demkowicz, A. Misra, A. Caro, The role of interface structure in controlling high Helium concentrations. Current Opin. Solid State Mater. Sci. 16, 101–108 (2012)
M.J. Demkowicz, J. Wang, R.G. Hoagland, Interfaces between dissimilar crystalline solids. Dislocat. Solids 14, 141–205 (2008)
M. Eldred, S. Giunta, S. Collis, Second-order corrections for surrogate-based optimization with model hierarchies, in AIAA Paper 2004-4457, Proceedings of the 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference (2004)
D. Eyre, An unconditionally stable one-step scheme for gradient systems. Unpublished manuscript, University of Utah, Salk Lake City, June (1998)
I. Ford, D.M. Titterington, K. Christos, Recent advances in nonlinear experimental design. Technometrics 31, 49–60 (1989)
E. Fu, N. Li, A. Misra, R. Hoagland, H. Wang, X. Zhang, Mechanical properties of sputtered cu/v and al/nb multilayer films. Mater. Sci. Eng.: A, 493, 283—287 (2008). Mechanical Behavior of Nanostructured Materials, a Symposium Held in Honor of Carl Koch at the TMS Annual Meeting 2007, Orlando, Florida
E. Fu, A. Misra, H. Wang, L. Shao, X. Zhang, Interface enabled defects reduction in helium ion irradiated Cu/V nanolayers. J. Nucl. Mater. 407, 178–188 (2010)
L.D. Gabbay, S. Senturia, Computer-aided generation of nonlinear reduced-order dynamic macromodels. I. Non-stress-stiffened case, Microelectromech. Syst. J. 9, 262–269 (2000)
T. Gerstner, M. Griebel, Dimension-adaptive tensor-product quadrature. Computing 71, 65–87 (2003)
R. Ghanem, P. Spanos, Stochastic Finite Elements: A Spectral Approach (Springer, Berlin, 1991)
J. Ginebra, On the measure of the information in a statistical experiment. Bayesian Anal. 2, 167–212 (2007)
M. Grepl, Y. Maday, N. Nguyen, A. Patera, Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations. Math. Model. Numer. Anal. (M2AN) 41, 575–605 (2007)
G.E. Hilley, R. Bürgmann, P.-Z. Zhang, P. Molnar, Bayesian inference of plastosphere viscosities near the kunlun fault, northern tibet, Geophys. Res. Lett. 32, n/a–n/a (2005)
J. Hirth, J. Lothe, Theory of Dislocations (Wiley, New York, 1992)
J.A. Hoeting, D. Madigan, A.E. Raftery, C.T. Volinsky, Bayesian model averaging: a tutorial. Stat. Sci. 14, 382–417 (1999)
P. Holmes, J. Lumley, G. Berkooz, Turbulence, Coherent Structures, Dynamical Systems and Symmetry (Cambridge University Press, Cambridge, 1996)
X. Huan, Y.M. Marzouk, Simulation-based optimal Bayesian experimental design for nonlinear systems. J. Comput. Phys. 232, 288–317 (2013)
X. Huan, Y.M. Marzouk, Gradient-based stochastic optimization methods in Bayesian experimental design. Int. J. Uncertain. Quantif. 4, 479–510 (2014)
H. Jeffreys, An invariant form for the prior probability in estimation problems, in Proceedings of the Royal Society (1946)
D.R. Jones, M. Schonlau, W.J. Welch, Efficient global optimization of expensive black-box functions. J. Global Optim. 13, 455–492 (1998)
A. Kashinath, A. Misra, M. Demkowicz, Stable storage of helium in nanoscale platelets at semicoherent interfaces. Phys. Rev. Lett. 110, 086101 (2013)
M.C. Kennedy, A. O’Hagan, Bayesian calibration of computer models. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 63, 425–464 (2001)
J. Kiefer, J. Wolfowitz, Stochastic estimation of the maximum of a regression function. Ann. Math. Stat. 23, 462–466 (1952)
J. Kristensen, N.J. Zabaras, Bayesian uncertainty quantification in the evaluation of alloy properties with the cluster expansion method. Comput. Phys. Commun. 185, 2885–2892 (2014)
H. Kushner, G. Yin, Stochastic Approximation and Recursive Algorithms and Applications, Applications of mathematics (Springer, Berlin, 2003)
O.P. Le Maître, O.M. Knio, Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics (Springer, Berlin, 2010)
J. Lewandowski, A. Greer, Temperature rise at shear bands in metallic glasses. Nat. Mater. 5, 15–18 (2006)
J. Li, Y.M. Marzouk, Adaptive construction of surrogates for the Bayesian solution of inverse problems. SIAM J. Sci. Comput. 36, A1163–A1186 (2014)
N. Li, E. Fu, H. Wang, J. Carter, L. Shao, S. Maloy, A. Misra, X. Zhang, He ion irradiation damage in Fe/W nanolayer films. J. Nucl. Mater. 389, 233–238 (2009)
N. Li, M. Martin, O. Anderoglu, A. Misra, L. Shao, H. Wang, X. Zhang, He ion irradiation damage in Al/ Nb multilayers. J. Appl. Phys. 105, 123522 (2009)
N. Li, J. Wang, J. Huang, A. Misra, X. Zhang, In situ tem observations of room temperature dislocation climb at interfaces in nanolayered Al/Nb composites. Scripta Materialia 63, 363–366 (2010)
D.V. Lindley, Bayesian Statistics, A Review (Society for Industrial and Applied Mathematics (SIAM), Philadelphia, 1972)
T.J. Loredo, Rotating stars and revolving planets: Bayesian exploration of the pulsating sky, in Bayesian Statistics 9: Proceedings of the Nineth Valencia International Meeting, Oxford University Press (2010), pp. 361–392
T.J. Loredo, D.F. Chernoff, Bayesian adaptive exploration, in Statistical Challenges of Astronomy (Springer, Berlin, 2003), pp. 57–69
D.J. MacKay, Information theory, inference, and learning algorithms, vol. 7, Citeseer (2003)
Y.M. Marzouk, H.N. Najm, Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems. J. Comput. Phys. 228, 1862–1902 (2009)
Y.M. Marzouk, H.N. Najm, L.A. Rahn, Stochastic spectral methods for efficient Bayesian solution of inverse problems. J. Comput. Phys. 224, 560–586 (2007)
Y.M. Marzouk, D. Xiu, A stochastic collocation approach to Bayesian inference in inverse problems. Commun. Comput. Phys. 6, 826–847 (2009)
J.E. Mehner, L.D. Gabbay, S.D. Senturia, Computer-aided generation of nonlinear reduced-order dynamic macromodels. II. Stress-stiffened case. Microelectromech. Syst. J. 9, 270–278 (2000)
Y. Mishin, M. Asta, J. Li, Atomistic modeling of interfaces and their impact on microstructure and properties. Acta Materialia 58, 1117–1151 (2010)
A. Misra, M. Demkowicz, X. Zhang, R. Hoagland, The radiation damage tolerance of ultra-high strength nanolayered composites. Jom 59, 62–65 (2007)
A. Misra, J. Hirth, R. Hoagland, Length-scale-dependent deformation mechanisms in incoherent metallic multilayered composites. Acta Materialia 53, 4817–4824 (2005)
T.E. Mitchell, Y.C. Lu, A.J.G. Jr, M. Nastasi, H. Kung, Structure and mechanical properties of copper/niobium multilayers. J. Am. Ceram. Soc. 80, 1673–1676 (1997)
J.I. Myung, M.A. Pitt, Optimal experimental design for model discrimination. Psychol. Rev. 116, 499–518 (2009)
J.A. Nelder, R. Mead, A simplex method for function minimization. Comput. J. 7, 308–313 (1965)
A. Noor, J. Peters, Reduced basis technique for nonlinear analysis of structures. AIAA J. 18, 455–462 (1980)
G. Odette, M. Alinger, B. Wirth, Recent developments in irradiation-resistant steels. Annu. Rev. Mater. Res. 38, 471–503 (2008)
M. Parno, P. Conrad, A. Davis, Y.M. Marzouk, MIT uncertainty quantification (MUQ) library. http://bitbucket.org/mituq/muq
V. Picheny, D. Ginsbourger, Y. Richet, G. Caplin, Quantile-based optimization of noisy computer experiments with tunable precision. Technometrics 55, 2–13 (2013)
Z.-Q. Qu, Model Order Reduction Techniques with Applications in Finite Element Analysis: With Applications in Finite Element Analysis (Springer Science & Business Media, Berlin, 2004)
C. Rasmussen, C. Williams, Gaussian Processes for Machine Learning (The MIT Press, Cambridge, 2006)
C.P. Robert, G. Casella, Monte Carlo Statistical Methods (Springer, Berlin, 2004)
K.J. Ryan, Estimating expected information gains for experimental designs with application to the random fatigue-limit model. J. Comput. Graph. Stat. 12, 585–603 (2003)
C. Schwab, A.M. Stuart, Sparse deterministic approximation of Bayesian inverse problems. Inv. Prob. 28, 045003 (2012)
S. Shao, H. Zbib, I. Mastorakos, D. Bahr, The void nucleation strengths of the cu-ni-nb-based nanoscale metallic multilayers under high strain rate tensile loadings. Comput. Mater. Sci. 82, 435–441 (2014)
A. Shapiro, Asymptotic analysis of stochastic programs. Ann. Oper. Res. 30, 169–186 (1991)
L. Sirovich, Turbulence and the dynamics of coherent structures. Part 1: coherent structures. Q. Appl. Math. 45, 561–571 (1987)
A. Solonen, H. Haario, M. Laine, Simulation-based optimal design using a response variance criterion. J. Comput. Graph. Stat. 21, 234–252 (2012)
J.C. Spall, An overview of the simultaneous perturbation method for efficient optimization. Johns Hopkins APL Tech. Dig. 19, 482–492 (1998)
A. Sutton, R. Balluffi, Interfaces in Crystalline Materials, Monographs on the Physics and Chemistry of Materials (Clarendon Press, Oxford, 1995)
H. Ullmaier, The influence of helium on the bulk properties of fusion reactor structural materials. Nucl. Fus. 24, 1039 (1984)
J. van den Berg, A. Curtis, J. Trampert, Optimal nonlinear Bayesian experimental design: an application to amplitude versus offset experiments. Geophy. J. Int. 155, 411–421 (2003)
A. Vattré, N. Abdolrahim, K. Kolluri, M. Demkowicz, Computational design of patterned interfaces using reduced order models. Sci. Rep. 4 (2014)
Y.-C. Wang, A. Misra, R. Hoagland, Fatigue properties of nanoscale Cu/Nb multilayers. Scripta materialia 54, 1593–1598 (2006)
B.P. Weaver, B.J. Williams, C.M. Anderson-Cook, D.M. Higdon, Computational enhancements to Bayesian design of experiments using Gaussian processes. Bayesian Analysis (2015)
Q. Wei, N. Li, N. Mara, M. Nastasi, A. Misra, Suppression of irradiation hardening in nanoscale V/Ag multilayers. Acta Materialia 59, 6331–6340 (2011)
Q. Wei, A. Misra, Transmission electron microscopy study of the microstructure and crystallographic orientation relationships in v/ag multilayers. Acta Materialia 58, 4871–4882 (2010)
B. Williams, D. Higdon, J. Gattiker, L. Moore, M. McKay, S. Keller-McNulty, Combining experimental data and computer simulations, with an application to flyer plate experiments. Bayesian Anal. 1, 765–792 (2006)
D. Xiu, Efficient collocational approach for parametric uncertainty analysis. Commun. Comput. Phys. 2, 293–309 (2007)
D. Xiu, J.S. Hesthaven, High-order collocation methods for differential equations with random inputs. SIAM J. Sci. Comput. 27, 1118–1139 (2005)
L. Yarin, The Pi-Theorem: Applications to Fluid Mechanics and Heat and Mass Transfer, vol. 1 (Springer, Berlin, 2012)
Y. Yoo, C. Jo, C. Jones, Compositional prediction of creep rupture life of single crystal ni base superalloy by Bayesian neural network, Materials Science and Engineering, pp. 22–29 (2001)
D. Yuryev, M. Demkowicz, Computational design of solid-state interfaces using o-lattice theory: an application to mitigating helium-induced damage. Appl. Phys. Lett. 105, 221601 (2014)
X. Zhang, E. Fu, A. Misra, M. Demkowicz, Interface-enabled defect reduction in he ion irradiated metallic multilayers. Jom 62, 75–78 (2010)
S. Zinkle, N. Ghoniem, Operating temperature windows for fusion reactor structural materials. Fusion Eng. Des. 51, 55–71 (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Aggarwal, R., Demkowicz, M.J., Marzouk, Y.M. (2016). Information-Driven Experimental Design in Materials Science. In: Lookman, T., Alexander, F., Rajan, K. (eds) Information Science for Materials Discovery and Design. Springer Series in Materials Science, vol 225. Springer, Cham. https://doi.org/10.1007/978-3-319-23871-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-23871-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23870-8
Online ISBN: 978-3-319-23871-5
eBook Packages: Chemistry and Materials ScienceChemistry and Material Science (R0)