AI inference
Inference is the use of a trained model to produce an output from an input
What it means, how it is used and where it comes up, with its related concepts.
What it is and how it works
It can generate a prediction, a classification or content. In an application, its design affects latency, cost and serving capacity. The result should be interpreted according to the task and the model's evaluation, without mistaking it for certainty.
Topics