Trust region Bayesian optimization.
Would be very easy to implement after allowing search spaces as a subclass of param space.
The "trust region" shrinks or expands by some specified value after some specified number of successful or failed optimization rounds.
Tends to outperform default BO.
Other versions exists with multiple trust regions which provides a convenient avenue for parallelization (n per TR)
Trust region Bayesian optimization.
Would be very easy to implement after allowing search spaces as a subclass of param space.
The "trust region" shrinks or expands by some specified value after some specified number of successful or failed optimization rounds.
Tends to outperform default BO.
Other versions exists with multiple trust regions which provides a convenient avenue for parallelization (n per TR)