Thinking Machines: Inkling Small
thinkingmachines/inkling-smallInkling Small is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 12B active parameters out of 276B total.
Modalities
In / out per 1M$0.45 / $1.20
Context512K
ReleasedJul 30, 2026
Providers
1 provider serves this model upstream.
| Provider | Input /M | Output /M | Cache read /M | Latency P50 | Throughput P50 | Uptime |
|---|---|---|---|---|---|---|
 DeepInfraus · fp8 | $0.45 | $1.20 | $0.10 | 0.43s | 141 tps | 99.85% |
Market-wide measurements, refreshed every 15 minutes. They describe who serves Inkling Small in general, not how ProjectCOZY routes your requests.
Pricing
List rates per 1M tokens — what Inkling Small costs pay-as-you-go elsewhere, not what you pay here.
Input
$0.45
per 1M tokens
Output
$1.20
per 1M tokens
Cache read
$0.10
per 1M cached tokens
Included in every pass
Inkling Small is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.
Performance
Time to first token and output speed across every provider, over the last 3 days.
0.0s100.0s200.0s300.0s400.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile
Uptime
100% of requests were served successfully over the last 3 days, across all providers.
Last 3 daysAvailability 98.96%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.95%
100% 97% 93% 90%
Oct 13, 2:40 PMNow
Apps
Tools that most often run Inkling Small, by tokens this week.
Activity
31.6B tokens processed market-wide in the last month.
02.0B4.0B6.0B8.0B
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens
FAQ
Which model id do I use for Inkling Small?
thinkingmachines/inkling-small. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Inkling Small hold?
524,288 tokens per request, of which up to 262,144 can be the response.
What can it accept and return?
Input: text, image, audio. Output: text.
What does Inkling Small cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.45 per 1M input tokens and $1.20 per 1M output tokens.
Who built Inkling Small?
Thinking Machines, in the Inkling family.
Explore
Other models your pass can call.
