Optimizing objectives under constraints, where both the objectives and
constraints are black box functions, is a common scenario in real-world
applications such as scientific experimental design, design of medical
therapies, and industrial process optimization. One popular approach to
handling these complex scenarios is Bayesian Optimization (BO). In terms of
theoretical behavior, BO is relatively well understood in the unconstrained
setting, where its principles have been well explored and validated. However,
when it comes to constrained Bayesian optimization (CBO), the existing
framework often relies on heuristics or approximations without the same level
of theoretical guarantees.
In this paper, we delve into the theoretical and practical aspects of
constrained Bayesian optimization, where the objective and constraints can be
independently evaluated and are subject to noise. By recognizing that both the
objective and constraints can help identify high-confidence regions of interest
(ROI), we propose an efficient CBO framework that intersects the ROIs
identified from each aspect to determine the general ROI. The ROI, coupled with
a novel acquisition function that adaptively balances the optimization of the
objective and the identification of feasible regions, enables us to derive
rigorous theoretical justifications for its performance. We showcase the
efficiency and robustness of our proposed CBO framework through empirical
evidence and discuss the fundamental challenge of deriving practical regret
bounds for CBO algorithms.

通过理论和实践方面的研究，发现在拥有噪声的约束贝叶斯优化中，通过识别高置信度兴趣区域，相交这些区域得出最终兴趣区域，并利用平衡优化和可行区域识别的新型获取函数，为其性能获得严谨的理论证明。