Bayesian model selection with SOBER and BASQ

[YannickNoelStephanKuhn]

Description

This introduces an interface to use the Bayesian optimisation and model selection algorithms SOBER and BASQ. To introduce them, six examples showcasing their abilities on optimisation, parameterisation, model selection, and surrogate modelling are appended.

Fixes #228

Type of change

Please add a line in the relevant section of CHANGELOG.md to document the change (include PR #).

Important checks:

Please confirm the following before marking the PR as ready for review:

• No style issues: $ pre-commit run or $ nox -s pre-commit (see CONTRIBUTING.md for how to set this up to run automatically when committing locally, in just two lines of code)
• All tests pass: nox -s tests
• The documentation builds: nox -s doctest
• Code is commented for hard-to-understand areas
• Tests added that prove fix is effective or that feature works

[codecov]

Codecov Report

❌ Patch coverage is 3.92610% with 416 lines in your changes missing coverage. Please review.
✅ Project coverage is 86.55%. Comparing base (4628a65) to head (9e99076).
⚠️ Report is 47 commits behind head on develop.

Files with missing lines	Patch %	Lines
pybop/optimisers/sober_basq_optimiser.py	0.00%	216 Missing ⚠️
pybop/models/lithium_ion/silicon_relaxation.py	0.00%	55 Missing ⚠️
pybop/models/kneepoints.py	0.00%	36 Missing ⚠️
pybop/models/_diffusive_decay.py	0.00%	26 Missing ⚠️
pybop/costs/endoflife_cost.py	0.00%	25 Missing ⚠️
pybop/plot/predictive.py	0.00%	20 Missing ⚠️
pybop/plot/correlation.py	18.18%	18 Missing ⚠️
pybop/processing/dataset.py	31.81%	15 Missing ⚠️
pybop/parameters/multivariate_distributions.py	37.50%	5 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop     #854      +/-   ##
===========================================
- Coverage    89.41%   86.55%   -2.87%     
===========================================
  Files           63       80      +17     
  Lines         4857     6114    +1257     
===========================================
+ Hits          4343     5292     +949     
- Misses         514      822     +308     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.