News & guides
OpenAI Node SDK Setup Against a Custom Base URL
Configure the official Node client for any OpenAI-compatible endpoint: retries, timeouts, abort signals, streaming, typed errors and the runtime traps in serverless.
· 9 min read
OpenAI Python SDK Setup for Any Compatible Endpoint
Configure the official Python client against a custom base URL: retries, timeouts, async, streaming, tool calls and the error hierarchy you should be catching.
· 9 min readopencode Setup Guide: Custom Providers in the Terminal
Configure opencode against your own OpenAI-compatible endpoint — the provider block, model naming, per-mode model choice, and how to verify tool calls work.
· 8 min read
Orchestrator-Worker Patterns for Agents That Hold Up
The orchestrator-worker shape is the one multi-agent design that reliably pays for itself. Here is how to build the lead, the brief and the synthesis step.
· 9 min read
Paged Attention: Virtual Memory for the KV Cache
Paged attention stores the KV cache in fixed-size blocks instead of one contiguous slab, which is what lets a server hold far more concurrent sessions.
· 9 min read
Parallel Tool Calls: When Concurrency Helps an Agent
Running tool calls concurrently cuts wall-clock time but not tokens, and it is only safe for some operations. How to decide what to parallelise.
· 8 min readPartial Failure Recovery: When Half the Agents Succeed
Six workers, four returned, two timed out. Whether to answer, retry or abort is a design decision — here is how to make it before the incident, not during.
· 9 min read
Per-Seat vs Per-Token Pricing: Which One Fits Your Team
Per-seat billing meters people, per-token billing meters work. Here is what each optimises for, which workloads each punishes, and how to model both.
· 11 min readPII in Prompts: How It Gets There and How to Get It Out
Personal data reaches model context through stack traces, fixtures and pasted tickets rather than through design. Detection, tokenisation and what to ask a vendor.
· 9 min read
Pinning Model Versions: Why Aliases Break Production Quietly
A stable model alias can point at different weights over time. How that breaks tuned prompts without any error, and what to pin instead.
· 8 min read
Planning Storage for Self-Hosted Model Weights
How to size disk for open-weight models: what drives checkpoint size, why quantisations and versions multiply it, and why storage is rarely the real constraint.
· 9 min readPositional Encoding: How a Transformer Knows Token Order
Attention is order-blind by default. How position gets injected, why the method decides how far context can stretch, and what you see when it fails.
· 9 min readReady to try it?
Every model behind one key. Start free and upgrade when it sticks.