Groq
Some models free
3 models · 2 Providers
Overview
API base
https://api.groq.com/openai/v1Env vars
GROQ_API_KEYWebsite
Docs
—
Auth
API Key
OpenAI compatible
Pricing
Retail
Usage outside the free tier is billed per token.Region
Global
Status
Operational
Updated
2026-08-20
Features
Load balancing
OpenAI compatible
Free quota
Free tier with unlimited calls on several open models
The free tier covers selected open models (e.g. Llama 3.1 8B); paid models are metered.
Providers (2)
Models offered (3)
| Model | ID | Context | Max output | Price ($/1M tokens) | Reasoning | Tool call | Structured | Available on |
|---|---|---|---|---|---|---|---|---|
| Llama 3.1 70B | meta/llama-3.1-70b | 128K | 8K | — | ? | 6 | ||
| Llama 3.1 8B | meta/llama-3.1-8b | 128K | 8K | — | ? | 3 | ||
| Mistral Large | mistral/mistral-large | 128K | 8K | $2.00 / $6.00 | ? | 2 |