Text model
llama3.1-70b-instruct-fp8 pricing
Lambda charges $0.12 per million input tokens and $0.30 per million output tokens for llama3.1-70b-instruct-fp8. Below: every rate that applies, what common workloads cost, and cheaper options.
- Input
- $0.12/ 1M
- Output
- $0.30/ 1M
- Context
- 131.1Ktokens
All rates
| Tier | Input | Output | Cache read | Cache write |
|---|---|---|---|---|
| Standard | $0.12 | $0.30 | — | — |
USD per million tokens. Long-context tiers apply when the whole prompt, cached tokens included, passes the threshold.
Work it out
What common workloads cost
| Workload | Per call | Cost per call | Calls a month | Per month |
|---|---|---|---|---|
| Chat reply | 1,500 input and 400 output tokens | $0.0003 | 100,000 | $30.00 |
| RAG answer, cached context | 2,000 fresh + 4,000 cached input, 500 output | $0.00087 | 100,000 | $87.00 |
| Agent step | 4,000 fresh + 8,000 cached input, 800 output | $0.00168 | 250,000 | $420.00 |
| Batch summary | 3,000 input and 300 output tokens via the Batch API | — | 1,000,000 | — |
Planning a mix of models? Simulate a workload with llama3.1-70b-instruct-fp8, alongside anything else you run.
Cheaper options
Current models that cost at least 15% less for a typical chat reply. Cheaper isn't always equivalent: test quality on your own prompts, then use veqen diff to see the impact at your volume.
| Model | Chat reply | Saving |
|---|---|---|
| lambda/lfm-40b | $0.00023 | 23% |
| lambda/llama-4-maverick-17b-128e-instruct-fp8 | $0.000115 | 62% |
| cloudflare/@cf/zai-org/glm-4.7-flash | $0.000251 | 16% |
| deepinfra/zai-org/GLM-4.7-Flash | $0.00025 | 17% |
Price history
No price changes since Veqen started tracking this model.
Compare
Last verified with price book 2026-10-22. Sources: Lambda pricing and LiteLLM's MIT-licensed price file. Track every call to this model, per customer or project: install the SDK.