How are online predictions handled versus batch predictions?
Reviewed by Jason Burns, Editorial Steward · Last updated
Online predictions are computed on demand at request time with tight latency budgets, while batch predictions are computed offline in scheduled jobs and stored for later lookup; each has distinct infrastructure, monitoring, and cost profiles.