News & guides
Running Frontier Models on Rented GPUs: What It Really Takes
Renting GPUs to serve open weights sounds like a shortcut past API pricing. The memory maths, the utilisation problem, and when it actually pays off.
· 10 min read
Scaling Laws Explained: What Predicts a Model Getting Better
Scaling laws describe how loss falls as compute, data and parameters grow. What they actually claim, where they stopped applying, and why it matters to you.
· 9 min read
Scratchpad Patterns: Giving an Agent Somewhere to Think
A durable scratchpad survives compaction, crashes and handoffs. What belongs on it, what does not, and how to stop it becoming a second transcript.
· 8 min read
Security Review for Open-Weight Models Before You Deploy
Downloading weights means running someone else's artefact inside your network. What to check on provenance, licence, serving stack and data flow.
· 9 min read
Self-Consistency Decoding: Ask Five Times, Take the Majority
Sampling several answers and voting beats a single answer on some tasks and is pure waste on others. The mechanism, the cost, and when to reach for it.
· 8 min readShared Memory Between Agents: Designs That Actually Hold
Agents that share a scratchpad drift, overwrite and confuse each other. Here are four shared-memory designs, what each one breaks, and how to pick.
· 9 min read
Showback Reporting for AI Spend Teams Will Actually Read
How to report LLM spend back to engineering teams without billing them: what a useful report contains, what cadence works, and which unit metrics survive scrutiny.
· 11 min read
Sparse vs Dense Activation: What Runs on Every Token
Sparse activation means most of a model sits idle for any given token. That single fact explains model pricing, memory bills and misleading spec sheets.
· 9 min read
Speculative Agent Execution: Running Ahead of the Decision
Agents spend most of their wall-clock time waiting. Speculative execution starts likely next steps early and discards the wrong guesses. Here is when it pays.
· 9 min readSpeculative Decoding in Practice: When It Pays Off
Speculative decoding is standard in serving stacks now, but the speedup is workload-dependent. What decides whether it helps you, and how to tell.
· 9 min read
Stop Sequences Explained: Ending Generation on Purpose
How stop sequences work, why they interact badly with tokenisation and streaming, and the finish_reason check most integrations forget to make.
· 8 min read
Streaming an OpenAI-Compatible API in TypeScript
Consuming SSE from a chat completions endpoint in TypeScript: reading the body stream, buffering partial frames, assembling tool-call deltas and cancelling cleanly.
· 9 min readReady to try it?
Every model behind one key. Start free and upgrade when it sticks.