A sequential adaptive sampling technique based on a local linear model for computer experiment applications

Garbo, Andrea

Title:

A sequential adaptive sampling technique based on a local linear model for computer experiment applications

dc.contributor.advisor	German, Brian J.
dc.contributor.author	Garbo, Andrea
dc.contributor.committeeMember	Kennedy, Graeme J.
dc.contributor.committeeMember	Lightsey, Edgar G.
dc.contributor.committeeMember	Mavris, Dimitri N.
dc.contributor.committeeMember	Apley, Daniel W.
dc.contributor.department	Aerospace Engineering
dc.date.accessioned	2019-05-29T14:03:35Z
dc.date.available	2019-05-29T14:03:35Z
dc.date.created	2019-05
dc.date.issued	2019-03-29
dc.date.submitted	May 2019
dc.date.updated	2019-05-29T14:03:35Z
dc.description.abstract	The objective of this dissertation research is to develop a model independent sequential adaptive sampling technique for surrogate model (SM) applications based on a local linear model. This technique, called Nearest Neighbors Adaptive Sampling (NNAS), is conceived to be conceptually simple, computationally robust, and easy to apply, all characteristics that are crucial for effective surrogate modeling application during early phases of the engineering design process. SMs are now regarded as powerful engineering tools for the approximation of expensive responses — obtained either from computer simulations or real experiments — via less computationally expensive mathematical models. The use of SMs is especially valuable during the preliminary design phase when engineers need fast and accurate tools to assess the performance of different configurations and to define the top-level specifications that will guide the entire design process. Due to the increasing importance of SMs, new strategies are continuously being devised to build more flexible SM formulations, to rigorously select an SM technique from a set of candidates, and to efficiently sample the design space to collect the data required to train an SM. The considerable influence of the sample distribution on SM accuracy motivates efforts to develop advanced strategies to improve for the sampling process. In particular, the adoption of sequential adaptive sampling techniques has been empirically shown to reduce the number of samples required to obtain an SM of specified accuracy. However, these techniques are typically challenging to implement, limited by assumptions about the response, and dependent on the SM formulation selected to supervise the sampling process (e.g. cross validation and Kriging based strategies), making them impracticable for most engineering design applications. In particular, model dependence — a common characteristic of most state-of-the-art adaptive sequential sampling techniques — may decrease the sampling efficiency if the guiding SM is inappropriately chosen. The proposed NNAS technique avoids the limitations of model dependence by introducing a new refinement metric — the Non Linearity Index (NLI) — which estimates the local nonlinear characteristics as the difference between the actual response value and the local function approximation represented by the hyperplane obtained via weighted least squares regression of the closest D+k neighbors, where D is the domain dimensionality. The use of local linear models to assess the nonlinear characteristics of the response without the need for a global SM is the key characteristic of NNAS that makes this strategy model independent. Additionally, NNAS introduces a new stochastic Pareto-ranking-based selection criterion to simultaneously maximize the refinement and exploration of the design space search, thereby ensuring a balance between the two behaviors. The initial NNAS and NLI formulations have also been expanded to include a form of directional sampling in which the algorithm identifies both region and direction of sampling. NNAS embodies the capabilities of sampling multi-response design spaces, working in batch-mode (i.e. adding more than one sample at time), and continuing the sampling process even in the event of a critical error in the function evaluation, e.g. the lack of convergence of a computational model at points in the design space. These characteristics together with its ease of implementation make NNAS a valuable, efficient and robust sampling strategy to use during the early phases of engineering design. A comprehensive set of test cases from low to high complexity and from low to high dimensionality is used to compare the performance of the proposed technique with that of other state-of-the-art sampling strategies, specifically a standard Latin hypercube design, a model dependent technique, and a model independent strategy. Results show the sampling effectiveness and the reduced computational cost of NNAS even in multi-response applications or in situations of function evaluation failure.
dc.description.degree	Ph.D.
dc.format.mimetype	application/pdf
dc.identifier.uri	http://hdl.handle.net/1853/61268
dc.language.iso	en_US
dc.publisher	Georgia Institute of Technology
dc.subject	Surrogate modeling
dc.subject	Adaptive sampling
dc.subject	Sequential sampling
dc.subject	Model independence
dc.subject	Parallel sampling
dc.subject	Multi-response sampling
dc.title	A sequential adaptive sampling technique based on a local linear model for computer experiment applications
dc.type	Text
dc.type.genre	Dissertation
dspace.entity.type	Publication
local.contributor.advisor	German, Brian J.
local.contributor.corporatename	College of Engineering
local.contributor.corporatename	Daniel Guggenheim School of Aerospace Engineering
local.relation.ispartofseries	Doctor of Philosophy with a Major in Aerospace Engineering
relation.isAdvisorOfPublication	4a7d0819-ea3c-456c-8711-eb3137c3ef6d
relation.isOrgUnitOfPublication	7c022d60-21d5-497c-b552-95e489a06569
relation.isOrgUnitOfPublication	a348b767-ea7e-4789-af1f-1f1d5925fb65
relation.isSeriesOfPublication	f6a932db-1cde-43b5-bcab-bf573da55ed6
thesis.degree.level	Doctoral