Understanding Inference and the Economics of Enterprise AI

How real is this? That people are taking inference costs seriously enough to invent a new line item "AI COGS"?