01 / The Model
Non-determinism
Ask the same question twice and get two different answers. This is normal behaviour, not a defect. It is also why AI work needs ongoing review rather than a one-time sign-off.
How you’ll hear it
“It gave a different answer yesterday.”
“It will. That is why we test it on a set of examples, not once.”
Avoid
Signing off an AI feature after one good demo.
The longer version
The same input can produce different output. That is normal behaviour, not a fault, and it changes how you assure quality: instead of checking one answer, you check behaviour across many examples and keep checking as things change.