error: EvalAPIError { code, message }

An object representing an error response from the Eval API.

code: String

The error code.

message: String

The error message.

finish_reason: String

The reason why the sample generation was finished.

input: Array[Input{ content, role}]

An array of input messages.

content: String

The content of the message.

role: String

The role of the message sender (e.g., system, user, developer).

max_completion_tokens: Integer

The maximum number of tokens allowed for completion.

model: String

The model used for generating the sample.

output: Array[Output{ content, role}]

An array of output messages.

content: String

The content of the message.

role: String

The role of the message (e.g. “system”, “assistant”, “user”).

seed: Integer

The seed used for generating the sample.

temperature: Float

The sampling temperature used.

top_p: Float

The top_p value used for sampling.

usage: Usage{ cached_tokens, completion_tokens, prompt_tokens, total_tokens}

Token usage details for the sample.

cached_tokens: Integer

The number of tokens retrieved from cache.

completion_tokens: Integer

The number of completion tokens generated.

prompt_tokens: Integer

The number of prompt tokens used.

total_tokens: Integer

The total number of tokens used.