An entropy search portfolio for bayesian optimization. arXiv:1406.4625

Bayesian optimization is a sample-efficient method for black-box global optimization. How-ever, the performance of a Bayesian optimiza-tion method very much depends on its explo-ration strategy, i.e. the choice of acquisition func-tion, and it is not clear a priori which choice will result in superior performance. While portfolio methods provide an effective, principled way of combining a collection of acquisition functions, they are often based on measures of past perfor-mance which can be misleading. To address this issue, we introduce the Entropy Search Portfolio (ESP): a novel approach to portfolio construction which is motivated by information theoretic con-siderations. We show that ESP outperforms ex-isting portfolio methods on several real and syn-thetic problems, including geostatistical datasets and simulated control tasks. We not only show that ESP is able to offer performance as good as the best, but unknown, acquisition function, but surprisingly it often gives better performance. Fi-nally, over a wide range of conditions we find that ESP is robust to the inclusion of poor acquisition functions.