Guide

Bayesian optimization for engineers

Most optimization campaigns waste runs on designs that were never going to win. Bayesian optimization changes the order: it builds a model from the results you already have, predicts which untested design is most informative, and runs that one next. Each result sharpens the next choice, so you reach a better design in far fewer experiments.

First the budget problem with a fixed grid, then how the next run gets chosen, what two example campaigns looked like, and where the optimizer sits in the loop you already run.

The loop
The Bayesian optimization loop: a task feeds a model, the acquisition step chooses an experiment, the observation updates the model, and the cycle repeats, carrying uncertainty and cost back each time.
Each result updates the model, which chooses the next experiment.
The budget problem

Why grid search runs out of budget

A five-parameter study at four levels each is 1,024 runs, and every one of them costs solver hours or lab time you do not get back. Most of those runs land in regions the first handful of results already ruled out, so the budget goes on confirming what you know instead of finding what you do not.

Coarsening the grid cuts the count but walks straight past a narrow optimum. Adding a parameter multiplies the whole thing again. The limit is not the size of the space, it is that a fixed plan cannot use anything it learns while it runs.

The mechanism

How Bayesian optimization chooses the next run

Instead of a fixed plan, it fits a model to the results so far and picks the point where a new result would teach it the most, then updates and repeats. The model carries both an estimate and a confidence for every untested setting, so the choice can weigh a promising prediction against a region nobody has probed yet. Each completed run moves both numbers, which is what makes the next choice different from the last one.

  1. Seed with a small design

    A short initial set of runs gives the model something to fit. It does not have to cover the space, it only has to span it.

  2. Fit and quantify what is unknown

    The model returns a predicted response and a confidence for every setting you could try. Confidence is narrow where you have data and wide where you do not.

  3. Score every candidate

    An acquisition step ranks untried settings by how much a result there would be worth: strong predicted value, high uncertainty, or a mix of the two.

  4. Run one, then refit

    You spend the expensive step once per turn. The result goes back in, the confidence bands move, and the ranking is different next time round.

Back to step two   Repeat until you hit the target or the budget, whichever comes first.
Two examples

What two example campaigns took

In an engineering scenario STOCHOS found about 11 percent lower pressure drop in about 47 trials rather than about 600, and in a chemical scenario it reached plus 6.2 points of yield over the incumbent in about 23 runs rather than about 150. Both are examples, each with its own setup; neither is a universal guarantee. In each case the solver, the rig, and the measurement stayed as they were, and only the order of the experiments changed.

Engineering scenario
about47trials

Rather than about 600, for about 11 percent lower pressure drop.

Chemical scenario
about23runs

Rather than about 150, for plus 6.2 points of yield over the incumbent.

Figures from two specific campaign setups, not a guarantee of what yours will do.

A DIM-GP fit of impact strength versus additive concentration: an orange mean curve inside a shaded uncertainty band, white dots for measured results, a down-weighted red outlier, and a green star marking the recommended next experiment where predicted value and uncertainty are both high.
The star is the proposal: the setting where predicted value and remaining uncertainty are both high.
On top of your tools

The plan stops being written in advance

The optimizer sits on top of the tools you already run, taking each completed result as its next input, so nothing about how you simulate or test has to change. You keep your solver settings, your rig, and your acceptance criteria. What changes is that the campaign plan stops being written in advance.

Constraints and competing targets go in as part of the problem statement rather than as a filter afterwards, so proposals that cannot be built or cannot be run are not proposed. The method page on Bayesian Optimization covers the acquisition step in detail, and AI for Chemical R&D shows the same loop applied to formulation and scale-up.

Common questions

01Does Bayesian optimization replace design of experiments?

No. A small initial design still seeds the model. Bayesian optimization decides what to run after that, instead of committing the whole budget up front.

02How many runs before Bayesian optimization helps?

It is built for limited, expensive data, so it starts proposing informative points early. The count depends on how many parameters you vary and how noisy the response is.

03What if my objectives conflict?

That is the normal case. Cost against performance, or yield against purity, are handled as a multi-objective problem: STOCHOS returns a trade-off set of best compromises, so you choose the balance instead of guessing it.

Related pages
Method

Bayesian Optimization

The loop, the acquisition step, and how STOCHOS applies it.

Solution

AI for Chemical R&D

The same loop applied to formulation, process tuning, and scale-up.

Product

STOCHOS

The predictive engine that runs the loop on your own infrastructure.

Index

News and Guides

Every guide and every release note in one place.

The engineering case runs the same loop, with a scoreboard. Take the engineering case

Next step

Point it at your next campaign

Bring your variables, your constraints, and the results you already have. STOCHOS returns the next run worth doing, and the best design so far.

Request a Demo Bayesian Optimization

Local-first. Your data stays on your infrastructure.

Partners, customers, and research collaborators
AnsysCADFEMSimuTech GroupMEScoTSNEBoschZFGEMUDLRAdler LackeMankiewiczDuluxPlixxentFraunhoferHochschule NiederrheinFUELL Lab AutomationHumotionUniversitaet HamburgRobert Bosch Stiftung