LSao10K: Llama 3 8B Lunaris
sao10k/l3-lunaris-8bLunaris 8B is a versatile generalist and roleplaying model based on Llama 3.
Modalities
In / out per 1M$0.04 / $0.05
Context8K
ReleasedAug 13, 2024
Providers
2 providers serve this model upstream.
| Provider | Input /M | Output /M | Cache read /M | Latency P50 | Throughput P50 | Uptime |
|---|---|---|---|---|---|---|
 DeepInfra (Turbo)us · fp8 | $0.04 | $0.05 | Variable | 0.20s | 90 tps | 100% |
| $0.04 | $0.05 | Variable | 0.53s | 67 tps | 99.95% |
Market-wide measurements, refreshed every 15 minutes. They describe who serves Llama 3 8B Lunaris in general, not how ProjectCOZY routes your requests.
Pricing
List rates per 1M tokens — what Llama 3 8B Lunaris costs pay-as-you-go elsewhere, not what you pay here.
Input
$0.04
per 1M tokens
Output
$0.05
per 1M tokens
Cache read
—
not published
Included in every pass
Llama 3 8B Lunaris is included in every ProjectCOZY pass at no extra cost — one flat rate, no per-token metering. The rates above are there for comparison.
Performance
Time to first token and output speed across every provider, over the last 3 days.
0.0s1.0s2.0s3.0s4.0s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
DeepInfra (Turbo) (us) Parasail
0 tok/s100 tok/s200 tok/s300 tok/s400 tok/s
Oct 11, 12 AMOct 11, 8 AMOct 11, 4 PMOct 12, 12 AMOct 12, 8 AMOct 12, 4 PMOct 13, 12 AMOct 13, 8 AMOct 13, 4 PMOct 14, 12 AMOct 14, 8 AM
DeepInfra (Turbo) (us) Parasail
Uptime
100% of requests were served successfully over the last 3 days, across all providers.
Last 3 daysAvailability 99.74%
Oct 11, 2:00 PMNow
Availability over the last 24 hoursAvailability 99.76%
100% 98% 97% 95%
Oct 13, 2:50 PMNow
Apps
Tools that most often run Llama 3 8B Lunaris, by tokens this week.
Activity
20.8B tokens processed market-wide in the last month.
0200.0M400.0M600.0M800.0M
Sep 14Sep 19Sep 24Sep 29Oct 4Oct 9Oct 14
Tokens
FAQ
Which model id do I use for Llama 3 8B Lunaris?
sao10k/l3-lunaris-8b. Send it as the model field from any OpenAI-compatible client, against http://192.168.1.55/v1.
How much context does Llama 3 8B Lunaris hold?
8,192 tokens per request, of which up to 7,372 can be the response.
What can it accept and return?
Input: text. Output: text.
What does Llama 3 8B Lunaris cost on a pass?
Nothing beyond the pass itself. Pay-as-you-go elsewhere it lists at $0.04 per 1M input tokens and $0.05 per 1M output tokens.
How current is its knowledge?
Training data runs to Dec 2023. Anything later has to come from your prompt or a tool call.
Who built Llama 3 8B Lunaris?
Sao10K, in the Llama family.
Explore
Other models your pass can call.
