ConversationTestRun
A conversation test run against one Agent version (1.55.0): a report of which expectations each repetition met, with the Calls by id, and from 1.63.0 the outcome of its suite's publish gate, which gates only once the Agent's owner names the suite. Ids, codes and counts only.
An object with 17 fields.
Fields
| Field | Type | Required | Description |
|---|---|---|---|
agent_id | AgentId | yes | |
agent_version | integer | yes | |
cost_lines | array of PromptEvalCostLine | yes | |
created_at | Timestamp | yes | |
created_by | ActorRef | yes | |
error_code | string or null | yes | |
finished_at | Timestamp or null | yes | |
gate | PromptEvalGateOutcome or null | no | How the run fares against its suite's publish gate (1.63.0), once completed; null for inline tests, for a suite with no gate and before completion. Absent from an api before 1.63.0. |
id | PromptEvalRunId | yes | |
job_id | JobId | yes | The agent.conversation_test job that runs it. |
object | "conversation_test_run" | yes | |
repetitions | integer | yes | |
started_at | Timestamp or null | yes | |
status | PromptEvalRunStatus | yes | |
suite_id | PromptEvalSuiteId or null | yes | Null for inline tests. |
summary | ConversationTestSummary or null | yes | Null until completed. |
tests | array of ConversationTestReport | yes | One report per test, in the order of the suite or the request; empty until run. |
Used by
The operations whose parameters, request body or responses name this shape directly.