What is Inference Economics, and why are tokens the unit of cost?
Reviewed by Jason Burns, Editorial Steward · Last updated
Inference economics is the study of the cost structure of running AI models in production; tokens are the unit of cost because most language models bill and consume compute per token processed, both on input (prompt) and output (completion).