News & guides
The Self-Hosting Break-Even Point, With Honest Inputs
Self-hosting beats per-token pricing above some volume. Working out where that point sits once engineering time and idle capacity are included.
· 9 min read
The Token Cost of Long Context: When 1M Is Worth Filling
A million-token window makes enormous prompts possible, not advisable. What filling it costs across model tiers, and when retrieval wins instead.
· 8 min read
The Token Cost of Reasoning Models: Paying for Hidden Output
Reasoning models emit tokens you never see and are billed for at output rates. How much that adds, and when the accuracy is worth it.
· 8 min read
The Token Cost of Tool Calls: Definitions Bill Every Turn
Tool definitions and results are prompt content, charged on every turn of every session. What a tool actually costs over a run, and how to shrink it.
· 8 min read
The Z.ai GLM Family Explained: What GLM-5.2 Changes
GLM-5.2 pairs MIT licensing with a 128K output ceiling and two reasoning modes. What the family offers, and the workloads it is uniquely good at.
· 9 min read
Throughput vs Latency: The Trade-off Behind Your Bill
Serving more tokens per second and serving them faster are opposing goals. The knob that reconciles them is batch size, and it decides both speed and price.
· 9 min read
Time to First Token: What It Measures and What Moves It
TTFT is dominated by prefill compute, queueing and network distance rather than by model speed. What each contributes, and how to measure it without fooling yourself.
· 9 min read
Timeout Tuning for LLM Calls: Picking Numbers That Hold
Connect, first-token and idle timeouts do different jobs. How to pick each from your own latency data, propagate deadlines, and avoid the default ten-minute wait.
· 9 min readToken Costs by Language: Why the Same Text Bills Differently
The same sentence costs more in some languages than in English, and code has its own profile. Where the multiplier comes from and how to measure yours.
· 9 min read
Tokenizer Differences: Why the Same Text Costs Different Amounts
Two models quoting the same price per million tokens can cost different amounts for identical text. Why tokenizers vary and what it does to your bill.
· 8 min read
Tokens Per Second Explained: Reading the Number Correctly
Tokens per second means different things depending on who is measuring. What drives generation speed, why quoted figures disagree, and how to measure yours.
· 9 min read
Tool Call Retries: Retry the Transport, Not the Judgement
Agents retry constantly, and most of it is wasted. How to tell a transport failure from a wrong decision, and what each one actually needs.
· 8 min readReady to try it?
Every model behind one key. Start free and upgrade when it sticks.