Skip to main content
An automation with the Add to dataset action appends a row for every trace that matches its filter, as the trace arrives. Use it to grow a dataset from production, for example every trace an online evaluation failed, or every trace with a given metadata value.

​
Create the automation

  1. Open the Trace Explorer and set the filter that selects the traces you want, for example an evaluation result or a metadata value.
  2. Click Automate in the toolbar. The automation drawer opens with the current filter as its subject.
LangWatch

Add Automation

  1. Pick Add to dataset as the action, choose the dataset, and map the trace fields to its columns. Columns named input, output, expected_output, contexts, total_cost, spans, trace_id and timestamp are mapped for you; any other column maps to the metadata key with the same name until you change it.
LangWatch

Add To Dataset

  1. Save. From then on, every trace that matches the filter adds one row to the dataset.
Also check: Automations for the delivery options and the automation history, and Datasets for the full list of trace fields a column can map to.
Last modified on September 6, 2026