Validate grader
$ openai fine-tuning:alpha:graders validate
POST/fine_tuning/alpha/graders/validate
Validate a grader.
Parameters
--grader: StringCheckGrader { input, name, operation, 2 more } or TextSimilarityGrader { evaluation_metric, input, name, 2 more } or PythonGrader { name, source, type, image_tag } or 2 more
The grader used for the fine-tuning job.
Validate grader
openai fine-tuning:alpha:graders validate \
--api-key 'My API Key' \
--grader '{input: input, name: name, operation: eq, reference: reference, type: string_check}'{
"grader": {
"type": "string_check",
"name": "Example string check grader",
"input": "{{sample.output_text}}",
"reference": "{{item.label}}",
"operation": "eq"
}
}
Returns Examples
{
"grader": {
"type": "string_check",
"name": "Example string check grader",
"input": "{{sample.output_text}}",
"reference": "{{item.label}}",
"operation": "eq"
}
}