DeepInfra ยท chat
Meta-Llama-3.1-8B-Instruct-Turbo
deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo
- Input price
- $0.020 / 1M tokens
- Output price
- $0.030 / 1M tokens
- Context window
- 131K tokens
- Lifecycle
- stable
Meta-Llama-3.1-8B-Instruct-Turbo for OpenAI-compatible gateway routing
Meta-Llama-3.1-8B-Instruct-Turbo is a DeepInfra chat model in the Ferro Labs live catalog with a 131K tokens context window, 131K tokens maximum output, and capabilities including Streaming.
Token pricing is listed as $0.020 / 1M tokens for input tokens and $0.030 / 1M tokens for output tokens. Route calls through the Ferro Labs AI Gateway by sending model as deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo to the OpenAI-compatible chat completions endpoint. The catalog lists this model as stable for normal gateway routing.
OpenAI-compatible usage example
curl https://api.ferrolabs.ai/v1/chat/completions \
-H "Authorization: Bearer $GATEWAY_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo", "messages": [{"role": "user", "content": "Hello!"}]}'
Capabilities
- Streaming
Modalities
Input
- Text
Output
- Text
More from DeepInfra
Catalog prices may change. Verify current provider terms before purchasing.