Thinking Machines: Inkling Small (free)

thinkingmachines/inkling-small-free

Inkling Small is an open-weight multimodal mixture-of-experts model from Thinking Machines Lab, with 12B active parameters out of 276B total.

Modalities
In / out per 1MFree / Free
Context1M
ReleasedJul 30, 2026

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
DeepInfraus · fp8$0.45$1.20$0.100.43s141 tps99.85%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Inkling Small (free) in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Inkling Small (free) costs pay-as-you-go elsewhere, not what you pay here.

Input
Free
per 1M tokens
Output
Free
per 1M tokens
Cache read
—
not published
Included in every pass
Inkling Small (free) is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s100.0s200.0s300.0s400.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 98.96%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.95%
100% 97% 93% 90%
Oct 13, 2:40 PMNow

Apps

Tools that most often run Inkling Small (free), by tokens this week.

Activity

31.6B tokens processed market-wide in the last month.

02.0B4.0B6.0B8.0B
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for Inkling Small (free)?
thinkingmachines/inkling-small:free. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Inkling Small (free) hold?
1,048,576 tokens per request, of which up to 262,144 can be the response.
What can it accept and return?
Input: text, image, audio. Output: text.
What does Inkling Small (free) cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at Free per 1M input tokens and Free per 1M output tokens.
Who built Inkling Small (free)?
Thinking Machines, in the Inkling family.

Explore

Other models your pass can call.