Skip to content

Tagged

Cost

2 posts on cost.

LLM model routing: a ladder, a cascade, and a kill switch

LLM model routing is two problems: a ladder that picks the model tier by what a wrong answer costs, and a cascade that answers when a provider dies. Here is how both are built, with the real chain, the real prices, and the paper that explains why the second one will not save you money.

Most of my AI bill was re-reading my own transcript

My usage dashboard blamed subagents and had a fix ready. Twenty minutes of tallying the raw transcripts said the opposite: the ten most expensive sessions of the week spawned no agents at all, and almost every token I paid for was the same conversation being read again.

← All insights