Skip to content
For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL.
Primary navigation

Suggested
Overview Models Agents Tools Audio & voice Production API reference

Graders

GradersGrader Models

Models
grader_inputs: array of string or ResponseInputText { text, type, prompt_cache_breakpoint } or object { text, type } or 2 more

A list of inputs, each of which may be either an input text, output text, input image, or input audio object.

label_model_grader: object { input, labels, model, 3 more }

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

multi_grader: object { calculate_output, graders, name, type }

A MultiGrader object combines the output of multiple graders to produce a single score.

python_grader: object { name, source, type, image_tag }

A PythonGrader object that runs a python script on the input.

score_model_grader: object { input, model, name, 3 more }

A ScoreModelGrader object that uses a model to assign a score to the input.

string_check_grader: object { input, name, operation, 2 more }

A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.

text_similarity_grader: object { evaluation_metric, input, name, 2 more }

A TextSimilarityGrader object which grades text based on similarity metrics.