Making the model prefer our tools: the priority that exists in no layer, the two primitives that do, and the `_meta` that crosses the gatewaySep 15, 2026
Sizing for agents: 275 input tokens for every output token, and why the bottleneck is still decodeSep 12, 2026
LiteLLM's MCP gateway: the second front door, the tool catalogue nobody bills, and why filtering it can make selection worseSep 11, 2026
Humans and agents on the same gateway: why `priority` does not prioritise, the 429 that brings down the whole pool, and the two ways to separate trafficSep 10, 2026
Virtual keys, budgets and limits in LiteLLM: the layer that decides who gets the GPU, and the four things the documentation gets wrongSep 8, 2026
LiteLLM on day 2: one worker per pod, six thousand seconds of timeout and the other five things to change before opening the trafficSep 8, 2026
LiteLLM and Langfuse: the operational pair, and the four places where the trace is lost between the gateway and the dashboardSep 7, 2026
Choosing the switchboard: which OSS gateway to put in front, and why the licence decides before the featuresJun 6, 2026