Inference

Using a trained AI model to process new input and produce output. When you send a message to the AI and receive a response, that's inference. Training happens once; inference happens every time the model is used. Most AI product costs relate to inference compute.