AionLabs: Aion-RP 1.0 (8B)

aion-labs/aion-rp-llama-3-1-8b

Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard-Auto, where LLMs evaluate each other’s responses.

Modalities
In / out per 1M$0.80 / $1.60
Context32K
ReleasedFeb 4, 2025

Providers

1 provider serves this model upstream.

Providers serving this model
ProviderInput /MOutput /MCache read /MLatency P50Throughput P50Uptime
AionLabs$0.80$1.60Variable1.11s34 tps100%

Market-wide measurements, refreshed every 15 minutes. They describe who serves Aion-RP 1.0 (8B) in general, not how ProjectCOZY routes your requests.

Pricing

List rates per 1M tokens — what Aion-RP 1.0 (8B) costs pay-as-you-go elsewhere, not what you pay here.

Input
$0.80
per 1M tokens
Output
$1.60
per 1M tokens
Cache read
—
not published
Included in every pass
Aion-RP 1.0 (8B) is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.

Performance

Time to first token and output speed across every provider, over the last 3 days.

0.0s5.0s10.0s15.0s20.0s
Oct 11, 3 AMOct 12, 4 PMOct 12, 10 PMOct 12, 11 PMOct 13, 5 AMOct 13, 7 AMOct 13, 4 PM
Median 90th percentile 99th percentile
0 tok/s25 tok/s50 tok/s75 tok/s100 tok/s
Oct 11, 3 AMOct 12, 4 PMOct 12, 10 PMOct 12, 11 PMOct 13, 5 AMOct 13, 7 AMOct 13, 4 PM
Median 90th percentile 99th percentile

Uptime

100% of requests were served successfully over the last 3 days, across all providers.

Last 3 daysAvailability 98.92%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.52%
100% 92% 83% 75%
Oct 13, 2:50 PMNow

Apps

Tools that most often run Aion-RP 1.0 (8B), by tokens this week.

Activity

66.5M tokens processed market-wide in the last month.

02.0M4.0M6.0M8.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens

FAQ

Which model id do I use for Aion-RP 1.0 (8B)?
aion-labs/aion-rp-llama-3.1-8b. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Aion-RP 1.0 (8B) hold?
32,768 tokens per request, of which up to 29,491 can be the response.
What can it accept and return?
Input: text. Output: text.
What does Aion-RP 1.0 (8B) cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.80 per 1M input tokens and $1.60 per 1M output tokens.
How current is its knowledge?
Training data runs to Dec 2023. Anything later has to come from your prompt or a tool call.
Who built Aion-RP 1.0 (8B)?
AionLabs, in the Aion family.

Explore

Other models your pass can call.