A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.
Inputs to the model - can contain template strings. Supports text, output text, input images, and input audio, either as a single item or an array of items.
A text input to the model.
An image input block used within EvalItem content arrays.
A list of inputs, each of which may be either an input text, output text, input image, or input audio object.
A text input to the model.
An image input block used within EvalItem content arrays.
A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.
A TextSimilarityGrader object which grades text based on similarity metrics.