Llama 3.1 405B
COMING SOONMeta · 2024-07-23 · Context 128,000
Tool calling
Providers
Different providers host this model; routing picks one and falls back on failure.
| Provider | In / Out | Latency | Status |
|---|---|---|---|
Together AI openai | $1.80 / $1.80 | ~600ms | No key |
DeepInfra openai | $1.79 / $1.79 | ~620ms | No key |
Quick call
cURL
curl https://allaiapp.com/api/v1/chat/completions \
-H "Authorization: Bearer $ALLAI_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "meta/llama-3.1-405b", "messages": [{"role":"user","content":"Hello"}]}'