class

OpenAI::GraderLabelModel

Inherits JSON::Serializable < Reference < Object

A LabelModelGrader object which uses a model to assign labels to each item in the evaluation.

Constructors

new(pull : JSON::PullParser)
Source
new(type_value : GraderLabelModelType = GraderLabelModelType::LabelModel, name : String = "", model : String = "", input : Array(EvalItem) = [] of EvalItem, labels : Array(String) = [] of String, passing_labels : Array(String) = [] of String)
Source
new(*, __pull_for_json_serializable pull : JSON::PullParser)
Source

Instance methods

input
Source
input=(input : Array(EvalItem))
Source
labels

The labels to assign to each item in the evaluation.

Source
labels=(labels : Array(String))

The labels to assign to each item in the evaluation.

Source
model

The model to use for the evaluation. Must support structured outputs.

Source
model=(model : String)

The model to use for the evaluation. Must support structured outputs.

Source
name

The name of the grader.

Source
name=(name : String)

The name of the grader.

Source
passing_labels

The labels that indicate a passing result. Must be a subset of labels.

Source
passing_labels=(passing_labels : Array(String))

The labels that indicate a passing result. Must be a subset of labels.

Source
type_value

The object type, which is always label_model.

Source
type_value=(type_value : GraderLabelModelType)

The object type, which is always label_model.

Source