Get Pass

OpenAI: GPT-3.5 Turbo 16k

openai/gpt-3-5-turbo-16k
CompareAPITry this model

This model offers four times the context length of gpt-3.5-turbo, allowing it to support approximately 20 pages of text in a single request at a higher cost.

Modalities
In / out per 1M$3.00 / $4.00
Context16K
ReleasedAug 28, 2023

Providers

2 providers serve this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
Azure$3.00$4.00Variable0.41s73 tps100%
OpenAI$3.00$4.00Variable0.56s89 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves GPT-3.5 Turbo 16k in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what GPT-3.5 Turbo 16k costs pay-as-you-go elsewhere, not what you pay here.

Input
$3.00
per 1M tokens
Output
$4.00
per 1M tokens
Cache read
—
not published
Included in every pass
GPT-3.5 Turbo 16k is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s1.0s2.0s3.0s4.0s
Oct 13, 8 AMOct 13, 9 AMOct 13, 10 AMOct 13, 11 AMOct 13, 12 PMOct 13, 1 PMOct 13, 2 PMOct 13, 3 PMOct 14, 8 AMOct 14, 10 AMOct 14, 11 AMOct 14, 12 PMOct 14, 1 PM
Azure OpenAI
0 tok/s20 tok/s40 tok/s60 tok/s80 tok/s
Oct 13, 8 AMOct 13, 9 AMOct 13, 10 AMOct 13, 11 AMOct 13, 12 PMOct 13, 1 PMOct 13, 2 PMOct 13, 3 PMOct 14, 8 AMOct 14, 10 AMOct 14, 11 AMOct 14, 12 PMOct 14, 1 PM
Azure

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.97%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 100%
100% 98% 97% 95%
Oct 13, 2:50 PMNow

Apps

Tools that most often run GPT-3.5 Turbo 16k, by tokens this week.

Kilo CodeCli Agent · 56.8% of tokens2.4MHaven Talk Blue SandboxPersonal Agent · 17.1% of tokens722.5Kuwisely.com10.3% of tokens435.5KOpen WebUIGeneral Chat · 7.9% of tokens333.5KpiCli Agent · 7.8% of tokens330.5K

Activity

48.0M tokens processed market-wide in the last month.

05.0M10.0M15.0M20.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for GPT-3.5 Turbo 16k?
openai/gpt-3.5-turbo-16k. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does GPT-3.5 Turbo 16k hold?
16,385 tokens per request, of which up to 4,096 can be the response.
What can it accept and return?
Input: text. Output: text.
What does GPT-3.5 Turbo 16k cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $3.00 per 1M input tokens and $4.00 per 1M output tokens.
How current is its knowledge?
Training data runs to Sep 2021. Anything later has to come from your prompt or a tool call.
Who built GPT-3.5 Turbo 16k?
OpenAI, in the GPT family.

Explore

Other models your pass can call.

Aion 3.5aion-labs/aion-3.5256KAionAion 3.5 Miniaion-labs/aion-3.5-mini256KAionAion-2.0aion-labs/aion-2.0128KAionAion-3.0aion-labs/aion-3.0128KAionAion-3.0-Miniaion-labs/aion-3.0-mini128KAionAion-RP 1.0 (8B)aion-labs/aion-rp-llama-3.1-8b32KAion