Skip to main content

Get started with LangWatch Skills in seconds: Set up evals, scenario tests, and tracing just by asking your AI coding assistant.

LangWatch home page

llms.txt
Sign In
langwatch/langwatch
langwatch/langwatch

Platform
Observability
AI Gateway
Self Hosting
API Reference
Sign In to LangWatch
Visit GitHub
Get Support

Traces

Overview
GET
Get trace details
GET
Get thread details
POST
Search traces
POST
Create public path for single trace
POST
Delete an existing public path for a trace

Prompts

Overview
GET
Get prompts
POST
Create prompt
GET
Get prompt
PUT
Update prompt
DEL
Delete prompt
GET
Get prompt versions
POST
Create prompt version

Annotations

Overview
GET
Get annotations
GET
Get single annotation
DEL
Delete single annotation
PATCH
Patch single annotation
GET
Get annotationa for single trace
POST
Create annotation for single trace

Datasets

POST
Add dataset entries programmatically using the LangWatch API to build evaluation sets for LLM testing and agent validation.

Automations

POST
Create Slack automation

Scenarios

Overview
POST
Create event

Evaluators

Overview
POST
Exact Match Evaluator
POST
LLM Answer Match
POST
BLEU Score
POST
LLM Factual Match
POST
ROUGE Score
POST
SQL Query Equivalence
POST
LLM-as-a-Judge Boolean Evaluator
POST
LLM-as-a-Judge Category Evaluator
POST
LLM-as-a-Judge Score Evaluator
POST
Rubrics Based Scoring
POST
Ragas Answer Correctness
POST
Ragas Answer Relevancy
POST
Ragas Context Precision
POST
Ragas Context Recall
POST
Ragas Context Relevancy
POST
Ragas Context Utilization
POST
Ragas Faithfulness
POST
Ragas Faithfulness
POST
Ragas Response Context Precision
POST
Ragas Response Context Recall
POST
Ragas Response Relevancy
POST
Context F1
POST
Context Precision
POST
Context Recall
POST
Azure Content Safety
POST
Azure Jailbreak Detection
POST
Azure Prompt Shield
POST
OpenAI Moderation
POST
Presidio PII Detection
POST
Custom Basic Evaluator
POST
Competitor Blocklist
POST
Competitor Allowlist Check
POST
Competitor LLM Check
POST
Off Topic Evaluator
POST
Query Resolution
POST
Semantic Similarity Evaluator
POST
Summarization Score
POST
Valid Format Evaluator
POST
Lingua Language Detection

Saved Evaluators

Overview
GET
List evaluators
GET
Get evaluator
POST
Create evaluator

Traces

Get thread details

Documentation Index
Fetch the complete documentation index at: https://langwatch.ai/docs/llms.txt
Use this file to discover all available pages before exploring further.

Was this page helpful?

Get trace details Search traces

⌘I

github website x-twitter linkedin youtube

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform