Skip to main content

Add the credential

Open Settings > Model Providers, click Add Model Provider and select Groq. Give the row a name, pick the organization, team or project it belongs to, and fill in: Save the row. Every virtual key whose scope can see the row can now dispatch to it, unless the key restricts its providers. See Virtual keys.

The Groq row: name, scope, GROQ_API_KEY and the routing handle groq.

Model names

Write groq/<model>, for example groq/llama-3.3-70b-versatile. The gateway does not infer Groq from a bare name.

Send a request

Endpoints

Last modified on September 6, 2026