← Back to Archive

The most common way to get a beautiful wrong answer

Plausible output from an incorrectly posed problem.

The most common way to get a beautiful wrong answer from a simulation is not a solver bug or a coarse mesh, it is posing the wrong question with great precision, so that the arithmetic answers it flawlessly and the flaw sits entirely in the choice of question.

A question written in equations

Every simulation is, underneath its geometry and physics settings, a question written in the language of equations, boundaries, and a mesh. Ask that question correctly and the solver's iterations will converge on a trustworthy answer to it. Ask it slightly wrong, with an inlet condition that does not match how the part operates, a symmetry assumption that does not hold, or a material property borrowed from the wrong alloy, and the solver has no way of noticing. It will iterate the wrong question with the same patience and produce the same crisp, colour-graded output it would have produced for the right one.

This is the failure mode that survives every other safeguard, because meshing checks and convergence checks are built to catch problems inside the arithmetic, and a mis-posed problem lives in the setup. The mesh can be fine, the residual can fall cleanly, the picture on screen can look exactly as a correct result is supposed to look, and the defect is untouched by all of it. Re-running with a finer mesh or a tighter convergence tolerance only improves how precisely the solver answers the question it was given, and a precisely wrong question sits no closer to a right one than a roughly wrong question did.

Every quality check built into a modern solver is aimed at the part of the process least likely to be hiding the real mistake. Mesh quality metrics, residual monitors and automated warnings about badly shaped cells all watch the arithmetic for signs of trouble, and none of them ask whether the question posed to that arithmetic corresponds to reality. A study can pass every automated check a piece of software offers and still be answering a question nobody needed answered.

Three wrong inputs out of hundreds

The error that starts this can be tiny relative to the setup around it. A single wrong boundary condition, a symmetry plane placed where the real geometry is not symmetric, or a material property pulled from a similar alloy is often a change to two or three input values out of the hundreds in a full setup, around one percent of what was typed in. A symmetry plane drawn down the middle of a bracket that is really loaded from one side, for instance, forces the solver to model a load shared evenly between two halves that in service share it very unequally. Because each of those inputs shapes the whole interior field the solver builds around it, that one percent can leave the result wrong by far more, and nothing in the process ties the size of the original mistake to the size or visibility of its consequences.

A beautiful suit cut to the wrong measurements

A tailor working from body measurements taken from the wrong customer will produce an excellent suit. The seams will be straight, the proportions balanced, the stitching invisible, every skill the tailor has on full display in the finished garment, and it will still not fit the person it is meant for, because the flaw sits in the measurements the sewing was faithfully executed against, recorded before a single stitch went in.

A simulation set up around the wrong assumption is that suit. The solving, the meshing and the post-processing can all be done to a high standard and still deliver a result that does not fit the real part, because the standard was applied to the wrong specification from the first step. Admiring the stitching tells you nothing about the fit, and the more skilled the tailor, or the more experienced the person running the study, the more convincing the finished result looks, which is what makes this failure dangerous as well as embarrassing. A rough, obviously careless piece of work invites scrutiny, while a polished one, wrong for reasons invisible in the output, tends to sail straight through.

A second tailor brought in to re-measure the finished suit against itself would find nothing wrong either, since checking a garment against its own construction only confirms that it was sewn consistently. Whether the customer it was built for was the right one is a question that has to go back to the measurements.

Checking the question before the answer

None of this means simulation cannot be trusted, only that the trust has to be placed correctly. A well-posed problem, checked at the point of setup as well as at the point of output, converges to an answer worth believing, and the great majority of simulation work does exactly that. The failure belongs to the moment a question gets written down wrong and nobody notices before the solver starts. A better solver or a finer mesh is beside the point here, and the defence is a second pair of eyes on the setup itself, asked to check the question before the machine is allowed to start proving, beautifully, that it can answer whatever it was given.

A review process that rewards how quickly a study reaches a converged result, over how carefully its setup was checked beforehand, encourages exactly the wrong instinct, treating speed to a clean residual plot as evidence of quality when all it shows is arithmetic health.

More on What a solver does