Skip to main content
LangWatch integrates with several third-party services for notifications, error tracking, and evaluation capabilities.

Email (SendGrid)

Email is used for alerts, team invitations, password resets, and system notifications. In NEXTAUTH_PROVIDER="email" mode, the sign-in screen’s “Forgot password?” link sends the reset email through this same provider, so configuring it here is what enables self-service password recovery.

Helm Configuration

Environment Variables

Setup Steps

  1. Create a SendGrid account and generate an API key
  2. Verify your sender domain in SendGrid
  3. Configure the API key via the Helm chart or environment variable
  4. Test by inviting a team member in the LangWatch UI

Error Tracking (Sentry)

Capture application errors and exceptions for debugging.

Configuration

Usage Analytics

LangWatch collects anonymous usage analytics by default to help improve the product. No trace data or PII is collected.

Disable Telemetry

Or via environment variable:

LLM Providers for Evaluations

LangWatch evaluators use external LLM providers for model-based evaluations (LLM-as-a-Judge, safety checks, etc.). Configure these if you want to use built-in evaluators.

Azure OpenAI

Used for jailbreak detection and content safety evaluators.

Google AI

Used for PII detection evaluators.
You don’t need to configure evaluator providers to use LangWatch. They’re only required if you want to use built-in evaluators that rely on specific LLM providers. You can always configure your own LLM provider API keys in the LangWatch UI for evaluations.

Slack

LangWatch can send notifications to Slack channels via webhooks for alerts and automations. This is configured in the LangWatch UI under Automations, not via environment variables.

S3, Object Storage

Used for dataset storage and ClickHouse cold storage/backups. See: