Built-in metrics
Cartesia calculates these metrics for every call:Custom metrics
Create an LLM-as-a-judge metric in the Playground, or withPOST /agents/metrics, using a name and evaluation prompt. The prompt should define one concrete question and the expected output. Create metrics under Metrics in the sidebar. Before saving, the Playground can run the prompt on an agent’s five most recent calls, or on call IDs you enter. Metrics can’t be edited after they’re created. To change one, delete it and create a new one.
Assign a metric
Assign metrics from the agent page in the Playground, or withPOST /agents/{agent_id}/metrics/{metric_id}. Cartesia evaluates calls that end after you assign the metric. When adding one in the Playground, you can check Run metric on the latest 5 calls to score recent calls once.

Add a metric from the agent's Metrics page.