The AI Gateway Grows Budgets

What You Can Do Now

Run the LangWatch AI Gateway like a platform

• Set budgets on every dimension, with live spend visible against each one, plus a redesigned virtual-key drawer for creating and managing keys.

• Provision through a REST surface aligned with the service layer: six-scope budgets, per-key spend reads, and n-by-n management from the CLI.

• Point a public status page at a dedicated gateway health endpoint.

• Reach non-Anthropic models from Claude Code through the router.

• A three-tier parameter policy for translated lanes, client max_tokens honored on the Anthropic, Bedrock, and Gemini lanes, and hosted provider catalogs listed in GET /v1/models.

• Upstream provider errors keep their identity through the gateway envelope, so a provider failure reads like that provider's failure.

Get started faster

• Launch-day polish: pre-provisioned tools, a subscription-first CLI flow, a redirect to your first trace, Opus 5 one-million-token pricing, and a clearer first-project affordance.

• CLI credentials on /me just work after device login.

Compare and analyze experiments

• A Bradley-Terry leaderboard chart for the Comparison evaluator, so pairwise results roll up into a ranking.

• Group the comparison table by dataset-entry metadata.

• Field selection and row-height controls on the batch evaluation results table.

Export your data

• Trace export pages with a cursor and includes spans and token metrics. Coding-agent transcripts are available over REST.

• Export scenario run history as CSV.

• Trace CSV export stopped dropping a row at every batch boundary.

Let Langy do the clicking

• Langy navigates the browser for you, opening the resource it surfaced right where you are.

• View in Trace Explorer opens the traces Langy searched.

Providers, privacy, and storage

• Google Agent Platform is available as a model provider.

• When a provider key is refused, we say why instead of just calling it invalid.

• Data privacy supports PII exception patterns, with a readable ingestion key id.

• Azure Blob is wired up as a stored-objects write destination.

Traces and search

• Free-text search now reaches trace and span names.

• Structured AI SDK output is surfaced in trace spans.

Screenshots

Budgets on every dimension, set right in the virtual-key drawer.

A breached budget, surfaced clearly.

Pre-provisioned tools on your personal workspace.

PII exception patterns in the data privacy editor.

Langy navigates you straight to the run it surfaced.

Notes

• Shipped in langwatch 3.8.0, alongside typescript-sdk 1.1.0.

• Node 25 and 26 are now supported alongside 24.

• The whole platform moved onto handled errors, so failures surface as typed, explainable errors rather than generic ones.

• Under the hood: a large event-sourcing rework (pipelines own their composition, span jobs travel as claim-checks) plus more ClickHouse partition-pruning and skip-index work.