An AI that is doing work. Inference is a peculiar name for sure; however, the term dates back to early AI systems. It refers to an AI model that is generating content, forecasting, translating languages, etc. In a regular non-AI system, the inference counterpart is an application processing data, in other words, what every application program does. See
inference engine and
AI training vs. inference.