TY - JOUR
T1 - Parallel efficient global optimization by using the minimum energy criterion
AU - Li, Shi Xiang
AU - Tian, Yubin
AU - Wang, Dianpeng
N1 - Publisher Copyright:
© 2023 Informa UK Limited, trading as Taylor & Francis Group.
PY - 2023
Y1 - 2023
N2 - In optimization problems, the expensive black-box function implies severely restricted budgets in terms of evaluation. Some Bayesian optimization methods have been proposed to solve this problem, such as expected improvement (EI) and hierarchical expected improvement (HEI). Neither EI nor HEI is parallel, which depends on a one-point-at-a-time strategy. In this work, a new parallel Bayesian framework based on the minimum energy criterion is proposed to improve these popular one-point methods. The new proposed framework can save time and costs by reducing the number of iterations and avoid the local optimization trap by encouraging the exploration of the optimization space. Additionally, a shrink-augment strategy is also introduced to correct the local surrogate model for the black-box function adaptively, which could also benefit the optimization. Some numerical and illustrative experiments are presented to demonstrate the superiority of our proposed method over some other Bayesian methods. The results show that the novel framework can balance exploitation and exploration well and has great performance in global optimization.
AB - In optimization problems, the expensive black-box function implies severely restricted budgets in terms of evaluation. Some Bayesian optimization methods have been proposed to solve this problem, such as expected improvement (EI) and hierarchical expected improvement (HEI). Neither EI nor HEI is parallel, which depends on a one-point-at-a-time strategy. In this work, a new parallel Bayesian framework based on the minimum energy criterion is proposed to improve these popular one-point methods. The new proposed framework can save time and costs by reducing the number of iterations and avoid the local optimization trap by encouraging the exploration of the optimization space. Additionally, a shrink-augment strategy is also introduced to correct the local surrogate model for the black-box function adaptively, which could also benefit the optimization. Some numerical and illustrative experiments are presented to demonstrate the superiority of our proposed method over some other Bayesian methods. The results show that the novel framework can balance exploitation and exploration well and has great performance in global optimization.
KW - Efficient global optimization
KW - expected improvement
KW - minimum energy criterion
KW - parallel strategy
UR - http://www.scopus.com/inward/record.url?scp=85161421569&partnerID=8YFLogxK
U2 - 10.1080/00949655.2023.2217707
DO - 10.1080/00949655.2023.2217707
M3 - Article
AN - SCOPUS:85161421569
SN - 0094-9655
VL - 93
SP - 3104
EP - 3125
JO - Journal of Statistical Computation and Simulation
JF - Journal of Statistical Computation and Simulation
IS - 17
ER -