Skip to content
For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL.
Primary navigation

Suggested
Overview Models Agents Tools Voice & Audio Production API reference
API Dashboard
Try ChatGPT
API Reference
Graders

Grader Models

ModelsExpand Collapse
GraderInputs = Array<string | ResponseInputText { text, type, prompt_cache_breakpoint } | OutputText { text, type } | 2 more>

A list of inputs, each of which may be either an input text, output text, input image, or input audio object.

LabelModelGrader { input, labels, model, 3 more }

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

MultiGrader { calculate_output, graders, name, type }

A MultiGrader object combines the output of multiple graders to produce a single score.

PythonGrader { name, source, type, image_tag }

A PythonGrader object that runs a python script on the input.

ScoreModelGrader { input, model, name, 3 more }

A ScoreModelGrader object that uses a model to assign a score to the input.

StringCheckGrader { input, name, operation, 2 more }

A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.

TextSimilarityGrader { evaluation_metric, input, name, 2 more }

A TextSimilarityGrader object which grades text based on similarity metrics.