VocalDocscontracts 1.65.0

LiveCallJudgment

One judgment of a Call that is not an evaluation Call (1.63.0): the suite's rubric judged over its stored transcript under live_call_judging, advisory and never a Call control. Content only in each item's rationale, under include.

An object with 19 fields.

Fields

FieldTypeRequiredDescription
advisorybooleanyesTrue while the suite's judge is not calibrated (promptEvalJudgeAdvisory); a judgment never controls a Call either way.
armExperimentArmKey or nullyesThe arm the experiment assigned.
call_idCallIdyes
completed_atTimestamp or nullyes
created_atTimestampyes
environmentEnvironmentyes
error_codestring or nullyes
experiment_idExperimentId or nullyesThe experiment whose suite judged the Call; null for no experiment.
idLiveCallJudgmentIdyes
job_idJobId or nullyesThe call.judge job that runs it.
judgeStageRef or nullyesThe judge that served it; null before.
object"live_call_judgment"yes
outcomePromptEvalOutcome or nullyespassed when every must and must_not item is judged pass or not_applicable; null until settled.
rubricarray of PromptEvalRubricVerdictyes
scorenumber or nullyesThe share of the applicable items judged pass; null until completed.
scrubbed_atTimestamp or nullyesWhen the retention scrub nulled the rationales with the Call's transcript.
statusLiveCallJudgmentStatusyes
suite_idPromptEvalSuiteIdyes
suite_revisionintegeryes