meta-llama/llama-3-70b-instruct
meta-llama/llama-3-70b-instruct (meta-llama) — 128K context, General tier. Input price: $1.122/M · Output price: $1.628/M · Avg latency 32ms. Routed via Routara OpenAI-compatible endpoint with multi-region failover and metered billing.
Input price: $1.122/M · Output price: $1.628/M · TTFT: 32ms
Specifications
- Developer: meta-llama
- Category: General
- Context window: 128K
- Input price: $1.122 / 1M
- Output price: $1.628 / 1M
- Avg latency: 32 ms
- SLA grade: A
Typical use cases
- Multilingual chatbots and customer support
- RAG pipelines with tool calling
- Code generation, review, and test synthesis
FAQ
- How is meta-llama/llama-3-70b-instruct priced on Routara? — Input tokens are billed at $1.122/M and output at $1.628/M. Charges are metered per request with no separate platform fee.
- Is meta-llama/llama-3-70b-instruct OpenAI-compatible? — Yes. Point any OpenAI SDK to https://api.routara.ai/v1 and set model to the Routara slug shown below.
- Does meta-llama/llama-3-70b-instruct support streaming? — Streaming is supported when the upstream route is live. Use stream: true in chat.completions.
Related models
- ai_infer_test_1 (/detail/ai-infer-test-1)
- ai_infer_test_2 (/detail/ai-infer-test-2)
- ai_infer_test_3 (/detail/ai-infer-test-3)
Quick integration
- curl https://api.routara.ai/v1/chat/completions \ -H "Authorization: Bearer YOUR_API_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"meta-llama/llama-3-70b-instruct","messages":[{"role":"user","content":"Hello"}],"stream":true}'