PromptEvalOutcome

How one evaluation Call or conversation test came out (1.55.0): passed, failed, or error, when it ended before a verdict could be reached.

An enumeration of 3 values.

Values

• passed
• failed
• error

Used by

The operations whose parameters, request body or responses name this shape directly.

• GET /v1/prompt-eval-suites/{prompt_eval_suite_id}/runs/{run_id}/verdicts