Get Pass

Cohere: Command R+ (08-2024)

cohere/command-r-plus-08-2024
CompareAPITry this model

command-r-plus-08-2024 is an update of the [Command R+](/models/cohere/command-r-plus) with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint

Modalities
In / out per 1M$2.50 / $10
Context125K
ReleasedAug 30, 2024

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
Cohere$2.50$10Variable0.47s9 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Command R+ (08-2024) in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Command R+ (08-2024) costs pay-as-you-go elsewhere, not what you pay here.

Input
$2.50
per 1M tokens
Output
$10
per 1M tokens
Cache read
—
not published
Included in every pass
Command R+ (08-2024) is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s20.0s40.0s60.0s80.0s
Oct 12, 12 AMOct 12, 7 AMOct 12, 8 AMOct 12, 12 PMOct 13, 1 AMOct 13, 7 PM
Median 90th percentile 99th percentile
0 tok/s20 tok/s40 tok/s60 tok/s80 tok/s
Oct 12, 12 AMOct 12, 7 AMOct 12, 8 AMOct 12, 12 PMOct 13, 1 AMOct 13, 7 PM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 99.96%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.91%
100% 95% 90% 85%
Oct 13, 2:50 PMNow

Apps

Tools that most often run Command R+ (08-2024), by tokens this week.

SillyTavernRoleplay · 54.5% of tokens23.5MJanitor AIRoleplay · 25.2% of tokens10.9MHelloHumans Bias Measurement9.2% of tokens4.0MnovelcrafterWriting Assistant · 5.8% of tokens2.5MDify.AIPersonal Agent · 5.3% of tokens2.3M

Activity

139.2M tokens processed market-wide in the last month.

010.0M20.0M30.0M40.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for Command R+ (08-2024)?
cohere/command-r-plus-08-2024. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Command R+ (08-2024) hold?
128,000 tokens per request, of which up to 4,000 can be the response.
What can it accept and return?
Input: text. Output: text.
What does Command R+ (08-2024) cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $2.50 per 1M input tokens and $10 per 1M output tokens.
How current is its knowledge?
Training data runs to Mar 2024. Anything later has to come from your prompt or a tool call.
Who built Command R+ (08-2024)?
Cohere, in the Command family.

Explore

Other models your pass can call.

Aion 3.5aion-labs/aion-3.5256KAionAion 3.5 Miniaion-labs/aion-3.5-mini256KAionAion-2.0aion-labs/aion-2.0128KAionAion-3.0aion-labs/aion-3.0128KAionAion-3.0-Miniaion-labs/aion-3.0-mini128KAionAion-RP 1.0 (8B)aion-labs/aion-rp-llama-3.1-8b32KAion