Skip to content
For the complete documentation index, see llms.txt. Markdown versions of documentation pages are available by appending .md to the page URL.
Primary navigation

Suggested
Overview Models Agents Tools Audio & voice Production API reference

Grader Models

Models
GraderInputItem = String | ResponseInputText { text, type, prompt_cache_breakpoint } | OutputText{ text, type} | 2 more

A single content item: input text, output text, input image, or input audio.

GraderInputs = Array[GraderInputItem]

A list of inputs, each of which may be either an input text, output text, input image, or input audio object.

class LabelModelGrader { input, labels, model, 3 more }

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

class MultiGrader { calculate_output, graders, name, type }

A MultiGrader object combines the output of multiple graders to produce a single score.

class PythonGrader { name, source, type, image_tag }

A PythonGrader object that runs a python script on the input.

class ScoreModelGrader { input, model, name, 3 more }

A ScoreModelGrader object that uses a model to assign a score to the input.

class StringCheckGrader { input, name, operation, 2 more }

A StringCheckGrader object that performs a string comparison between input and reference using a specified operation.

class TextSimilarityGrader { evaluation_metric, input, name, 2 more }

A TextSimilarityGrader object which grades text based on similarity metrics.