VocalDocs

TurnLlmProvider

One language model Provider that served the Turn, with the tokens it handled.

An object with 7 fields.

Fields

credential_key_idCredentialKeyId or nullrequired
The ID of the credential key the entry used: a platform key's plk_ ID or an Organization Provider credential's pcr_ ID. Null when no key ID is known. Never the secret or its hint.
failover_reasonProviderLossKind or nullrequired
Why the stage moved to this entry from the one before it: the loss_kind of the provider_unavailable mark that took the earlier entry out of service, or unavailable when no error was recorded. Null on the first entry, and on an entry the stage did not move to because of a loss.
llm_tokens_ininteger or nullrequired
Input tokens of the model rounds this entry served in the Turn, the unit of usage.llm_tokens_in, as the Provider reported them; null when it reported none.
llm_tokens_outinteger or nullrequired
Output tokens of the model rounds this entry served in the Turn, the unit of usage.llm_tokens_out, as the Provider reported them; null when it reported none.
modelstringrequired
The model the entry served the stage with, as the Provider names it: the recognizer or language model, or the speech model of a voice.
providerProviderIdrequired
The squad key of the Agent this entry served: self for the root Agent, or a key of the Turn's speakers. A Turn with a handoff lists the llm stage once per speaker with the tokens each used. When absent, the entry belongs to the root Agent.