Thinking Machines: Inkling

thinkingmachines/inkling

Inkling is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 41B active parameters out of 975B total.

Modalities
In / out per 1M$1.00 / $4.05
Context512K
ReleasedJul 17, 2026

Providers

2 providers serve this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
DeepInfraus · fp8$0.95$4.05$0.160.56s83 tps98.09%
Together$1.00$4.05$0.170.89s93 tps97.34%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Inkling in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Inkling costs pay-as-you-go elsewhere, not what you pay here.

Input
$1.00
per 1M tokens
Output
$4.05
per 1M tokens
Cache read
$0.17
per 1M cached tokens
Included in every pass
Inkling is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s2.5s5.0s7.5s10.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
DeepInfra (us) Together
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
DeepInfra (us) Together

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 97.61%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 98.46%
100% 86% 73% 60%
Oct 13, 2:50 PMNow

Apps

Tools that most often run Inkling, by tokens this week.

Activity

113.2B tokens processed market-wide in the last month.

05.0B10.0B15.0B20.0B
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for Inkling?
thinkingmachines/inkling. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Inkling hold?
524,288 tokens per request, of which up to 471,859 can be the response.
What can it accept and return?
Input: text, image, audio. Output: text.
What does Inkling cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $1.00 per 1M input tokens and $4.05 per 1M output tokens.
Who built Inkling?
Thinking Machines, in the Inkling family.

Explore

Other models your pass can call.