OpenAI: GPT-4o (2024-08-06)

openai/gpt-4o-2024-08-06

The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/).

Modalities
In / out per 1M$2.50 / $10
Context125K
ReleasedAug 6, 2024

Providers

2 providers serve this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
Azure$2.50$10$1.251.00s59 tps100%
OpenAI$2.50$10$1.251.58s68 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves GPT-4o (2024-08-06) in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what GPT-4o (2024-08-06) costs pay-as-you-go elsewhere, not what you pay here.

Input
$2.50
per 1M tokens
Output
$10
per 1M tokens
Cache read
$1.25
per 1M cached tokens
Included in every pass
GPT-4o (2024-08-06) is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s1.0s2.0s3.0s4.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Azure OpenAI
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
Azure OpenAI

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.87%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.91%
100% 98% 97% 95%
Oct 13, 2:40 PMNow

Apps

Tools that most often run GPT-4o (2024-08-06), by tokens this week.

Activity

9.5B tokens processed market-wide in the last month.

0200.0M400.0M600.0M800.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for GPT-4o (2024-08-06)?
openai/gpt-4o-2024-08-06. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does GPT-4o (2024-08-06) hold?
128,000 tokens per request, of which up to 16,384 can be the response.
What can it accept and return?
Input: text, image, file. Output: text.
What does GPT-4o (2024-08-06) cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $2.50 per 1M input tokens and $10 per 1M output tokens.
How current is its knowledge?
Training data runs to Oct 2023. Anything later has to come from your prompt or a tool call.
Who built GPT-4o (2024-08-06)?
OpenAI, in the GPT family.

Explore

Other models your pass can call.