Compare

Llama 3.1 8B Instruct vs …

Put models side by side on context, price, speed and availability.

Side-by-side comparison of the selected models
Model
Overview
Developer Meta
Context tokens128K
Max output tokens115K
Input text
Output text
Providers 5
Released Jul 23, 2024
Pricing
Input per 1M$0.05
Output per 1M$0.08
Cache read per 1M$0.03
Performance
Latency p50, median provider0.49s
Throughput p50, median provider88 tps
Uptime last 24h100.00%

Add a model