01 / The Model
Training
The one-off, enormously expensive process that sets those numbers, by showing the model vast amounts of text until it gets good at guessing what comes next. It happens once. Using the model never changes it.
How you’ll hear it
“Will it learn from our feedback?”
“Not by itself. Training is finished. We would have to feed that feedback back in another way.”
Avoid
Saying “it is learning as we use it”. Everyday use does not change the model.
The longer version
Training happens once, before you ever use the model, and costs a great deal. After that the model is fixed. Improvement in your product comes from changing what surrounds the model, or from a separate, deliberate step such as fine-tuning.