Grey-Box Bayesian Optimization: Improving Performance by Looking Inside the Black-Box

Toscano Palmerin, Saul

Grey-Box Bayesian Optimization: Improving Performance by Looking Inside the Black-Box

Abstract

Non-convex time-consuming objectives are often optimized using “black-box” optimization. These approaches assume very little about the objective. While broadly applicable, these approaches typically require more evaluations than methods exploiting more problem structure. In particular, often, we can acquire information about the objective function in ways other than direct evaluation, which is less time-consuming than evaluating the objective directly. This allows us to develop novel Bayesian optimization algorithms that outperform methods that rely only objective function evaluations. In this thesis, we consider three problems: optimization of sum and integrals of expensive-to-evaluate integrands; optimizing hyperparameters for iteratively trained supervised learning machine learning algorithms; and optimizing non-convex functions with a new efficient multistart stochastic gradient descent algorithm.

Description

184 pages

Date Issued

2020-05

Keywords

Bayesian optimization; black-box optimization; Gaussian process

Committee Chair

Frazier, Peter

Committee Member

Henderson, Shane
Bindel, David

Degree Discipline

Operations Research and Information Engineering

Degree Name

Ph. D., Operations Research and Information Engineering

Degree Level

Doctor of Philosophy

Types

dissertation or thesis