Chapter 14 of 15

Alert on Cost Velocity, Not Only Monthly Total

A monthly budget alert can tell me the damage after it has accumulated. AI systems need near-real-time signals for unusual spend rate, runaway runs, customer anomalies, and changes in cost per successful outcome.

  • Daily and hourly spend velocity
  • Runaway-run alerts
  • Customer anomaly alerts
  • Cost-per-success regressions
  • Incident response

The situation

A coding agent or multimodal workflow can create meaningful spend in a short period. By the time a monthly threshold fires, the underlying bug or abuse pattern may have been active for days.

The naive solution

Set provider billing alerts at 50%, 80%, and 100% of the monthly budget.

The hidden constraint

Monthly percentage alerts do not understand expected timing. Reaching 20% of the budget on day one can be more concerning than reaching 80% on day twenty-eight.

The decision

Monitor spend velocity and efficiency alongside absolute totals. I want alerts that tell me when the shape of usage changes unexpectedly.

The implementation

Useful signals include hourly/daily spend versus baseline, cost per successful workflow, retry cost percentage, individual run cost, cost by organisation, premium-model share, cache hit rate, and failed-run spend. Alerts should route to someone who can take an action such as disabling a feature flag, lowering a run budget, changing routing, blocking an abusive account, or switching a provider.

The tradeoff

Too many alerts become noise. I would start with a small number tied to clear actions and tune them from incidents rather than monitoring every metric equally.

The evidence I would look for

The operational goal is to reduce time from abnormal behaviour to intervention. A good system catches a runaway feature while the cost is still small enough to be a debugging incident, not a finance surprise.

The reusable lesson

Budgets tell me how much I can spend. Velocity tells me whether something is going wrong right now.

The consultant's questions

  • How quickly would you know if AI spend doubled today?
  • What is the most expensive single run allowed to complete silently?
  • Are failed runs included in efficiency alerts?
  • Does every important alert have a defined mitigation action and owner?