Blog

News & guides

Guides

OpenAI Python SDK Setup for Any Compatible Endpoint

Configure the official Python client against a custom base URL: retries, timeouts, async, streaming, tool calls and the error hierarchy you should be catching.

· 9 min read
Guides

opencode Setup Guide: Custom Providers in the Terminal

Configure opencode against your own OpenAI-compatible endpoint — the provider block, model naming, per-mode model choice, and how to verify tool calls work.

· 8 min read
Guides

PII in Prompts: How It Gets There and How to Get It Out

Personal data reaches model context through stack traces, fixtures and pasted tickets rather than through design. Detection, tokenisation and what to ask a vendor.

· 9 min read
Guides

Pre-Commit Hooks That Call an LLM: Worth It or Not?

How to wire a model into a git pre-commit hook, which checks actually belong there, and the latency and cost budget that decides whether the team keeps it.

· 9 min read
Guides

Prompt Templates and Versioning: Treating Prompts as Code

Prompts drift, break silently and get edited in production. How to template them safely, version them properly and know which version produced which output.

· 9 min read
Guides

Proxying LLM Traffic: What a Gateway Has to Get Right

Putting a gateway in front of an inference provider centralises keys, budgets and routing. Here is what breaks if you get streaming, headers or cancellation wrong.

· 9 min read
Guides

Redacting Secrets From Prompts Before They Leave Your Machine

Credentials reach model context through error output, config files and git history. Pre-send scanning, why gitignore is no defence, and rotating on suspicion.

· 9 min read
Guides

Streaming an OpenAI-Compatible API in TypeScript

Consuming SSE from a chat completions endpoint in TypeScript: reading the body stream, buffering partial frames, assembling tool-call deltas and cancelling cleanly.

· 9 min read
Guides

Streaming in Python: Reading SSE From an LLM API

Consume an OpenAI-compatible token stream in Python — the raw wire format, parsing data lines, partial chunks, tool-call deltas, timeouts and what buffering breaks.

· 9 min read
Guides

Timeout Tuning for LLM Calls: Picking Numbers That Hold

Connect, first-token and idle timeouts do different jobs. How to pick each from your own latency data, propagate deadlines, and avoid the default ten-minute wait.

· 9 min read
Guides

Using an LLM for Database Schema Design, Carefully

A model will produce a plausible schema in seconds. Plausible is the problem. How to brief it with queries, review the parts it gets wrong, and keep migrations safe.

· 9 min read
Guides

Using an LLM to Generate and Edit Config Files

Config generation is one of the safest LLM tasks if you supply the schema and validate mechanically. How to set it up, and the plausible-key failure mode to guard against.

· 9 min read

Ready to try it?

Every model behind one key. Start free and upgrade when it sticks.