Qwen: Qwen2.5 7B Instruct

qwen/qwen-2-5-7b-instruct

Qwen2.5 7B is the latest series of Qwen large language models.

Modalities
In / out per 1M$0.10 / $0.20
Context32K
ReleasedOct 16, 2024

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
Phala$0.10$0.20Variable0.29s110 tps99.28%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Qwen2.5 7B Instruct in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Qwen2.5 7B Instruct costs pay-as-you-go elsewhere, not what you pay here.

Input
$0.10
per 1M tokens
Output
$0.20
per 1M tokens
Cache read
—
not published
Included in every pass
Qwen2.5 7B Instruct is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s2.0s4.0s6.0s8.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.21%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.81%
100% 95% 90% 85%
Oct 13, 2:50 PMNow

Apps

Tools that most often run Qwen2.5 7B Instruct, by tokens this week.

Activity

22.2B tokens processed market-wide in the last month.

0500.0M1.0B1.5B2.0B
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for Qwen2.5 7B Instruct?
qwen/qwen-2.5-7b-instruct. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Qwen2.5 7B Instruct hold?
32,768 tokens per request, of which up to 29,491 can be the response.
What can it accept and return?
Input: text. Output: text.
What does Qwen2.5 7B Instruct cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.10 per 1M input tokens and $0.20 per 1M output tokens.
How current is its knowledge?
Training data runs to Jun 2024. Anything later has to come from your prompt or a tool call.
Who built Qwen2.5 7B Instruct?
Qwen, in the Qwen2.5 family.

Explore

Other models your pass can call.