Experiential
ModelsLogs
Star us on GitHubDocsSettings
Sign in
Continue with GoogleContinue with GitHub
or
Models

Llama 3.1 70B Instruct

llama-3.1-70b-instructby Llama
Try in Playground

Context

131K

Max output

no data

Price per million tokens

$0.40in$0.40out

-5%

Released

Jul 2024

Waterfall

  1. 1
    OpenRouter$0.40/$0.4099.9% up--

Quickstart

I want you to route my LLM calls for "llama-3.1-70b-instruct" through the Experiential gateway instead of calling the provider directly. It speaks the OpenAI Chat Completions API, so this is a base-URL and key swap. Please:

1. Point the client at https://api-pr-455.preview.experientiallabs.ai/v1 as the base URL.
2. Authenticate with my Experiential API key from the EXPLABS_API_KEY environment variable. If it isn't set, stop and tell me to create one under Settings -> API Keys and export it.
3. Use the model id "llama-3.1-70b-instruct" exactly.
4. Update every place my code builds an LLM client for this model to use that base URL and key, leaving streaming and tool-calls as they are.
5. Make one test call and show me the reply plus the token usage, so we confirm it runs on my Experiential credits.

Tell me which files you changed.
CapabilitiesAccepts text

Streaming

Streaming

Limits

Max-tokens fieldmax_tokens

Sending an unsupported field? See error referenceOpenRouter docs

Benchmarks5
BenchmarkScoreSource
MMLUHugging Face · Aug 202683.6%Hugging Face · Aug 2026
MMLU-ProHugging Face · Aug 202666.4%Hugging Face · Aug 2026
GPQA DiamondHugging Face · Aug 202648.0%Hugging Face · Aug 2026
IFEvalHugging Face · Aug 202687.5%Hugging Face · Aug 2026
LMArena EloLMArena · Aug 20261293LMArena · Aug 2026
Providers serving this model1
Status
OpenRouterexperientialno datano data99.9%#1 / 1131Kno data$0.40$0.40no data-no dataactive-
Hugging Face