Compare

Llama 3.1 70B Instruct vs …

Put models side by side on context, price, speed and availability.

Side-by-side comparison of the selected models
Model
Overview
Developer Meta
Context tokens128K
Max output tokens16K
Input text
Output text
Providers 2
Released Jul 23, 2024
Pricing
Input per 1M$0.40
Output per 1M$0.40
Cache read per 1MVariable
Performance
Latency p50, median provider0.45s
Throughput p50, median provider40 tps
Uptime last 24h100.00%

Add a model