Get Pass

OpenAI: GPT-3.5 Turbo

openai/gpt-3-5-turbo
CompareAPITry this model

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.

Modalities
In / out per 1M$0.50 / $1.50
Context16K
ReleasedMay 28, 2023

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
OpenAI$0.50$1.50Variable0.70s72 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves GPT-3.5 Turbo in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what GPT-3.5 Turbo costs pay-as-you-go elsewhere, not what you pay here.

Input
$0.50
per 1M tokens
Output
$1.50
per 1M tokens
Cache read
—
not published
Included in every pass
GPT-3.5 Turbo is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s2.0s4.0s6.0s8.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.98%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.98%
100% 98% 97% 95%
Oct 13, 2:50 PMNow

Apps

Tools that most often run GPT-3.5 Turbo, by tokens this week.

MagicChat38.8% of tokens40.0MAI Influence ModGame · 20.3% of tokens20.9MGlobalView Next16% of tokens16.5MBoxy Rescue - AI Classification12.7% of tokens13.1MJanitor AIRoleplay · 12.1% of tokens12.5M

Activity

2.9B tokens processed market-wide in the last month.

0100.0M200.0M300.0M400.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for GPT-3.5 Turbo?
openai/gpt-3.5-turbo. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does GPT-3.5 Turbo hold?
16,385 tokens per request, of which up to 4,096 can be the response.
What can it accept and return?
Input: text. Output: text.
What does GPT-3.5 Turbo cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.50 per 1M input tokens and $1.50 per 1M output tokens.
How current is its knowledge?
Training data runs to Sep 2021. Anything later has to come from your prompt or a tool call.
Who built GPT-3.5 Turbo?
OpenAI, in the GPT family.

Explore

Other models your pass can call.

Aion 3.5aion-labs/aion-3.5256KAionAion 3.5 Miniaion-labs/aion-3.5-mini256KAionAion-2.0aion-labs/aion-2.0128KAionAion-3.0aion-labs/aion-3.0128KAionAion-3.0-Miniaion-labs/aion-3.0-mini128KAionAion-RP 1.0 (8B)aion-labs/aion-rp-llama-3.1-8b32KAion