meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo
meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo — available through the Autonomous Relay Agents API, served by DeepInfra.
meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo has a 131,072-token context window and costs $0.02 per million input tokens and $0.04 per million output tokens, at the provider's list price on your own key.
- Context length
- 131,072 tokens
- Input
- $0.02 per M
- Output
- $0.04 per M
- Served by
- deepinfra
- Input modalities
- text
This is a BYOK-only model: requests use your own provider key. Prices shown are the provider's list prices.
Call it
Any OpenAI-compatible client works: change the base URL and send this model id.
curl https://autonomousrelay.com/v1/chat/completions \
-H "Authorization: Bearer $AUTONOMOUS_RELAY_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo", "messages": [{"role": "user", "content": "Hello"}]}'