class

OpenAI::CreateEvalRequest

Inherits JSON::Serializable < Reference < Object

Constructors

new(pull : JSON::PullParser)
Source
new(name : String | Nil = nil, metadata : Metadata | Nil = nil, data_source_config : CreateEvalRequestDataSourceConfig = CreateEvalCustomDataSourceConfig.new, testing_criteria : Array(CreateEvalRequestTestingCriteriaItem) = [] of CreateEvalRequestTestingCriteriaItem)
Source
new(*, __pull_for_json_serializable pull : JSON::PullParser)
Source

Instance methods

data_source_config

The configuration for the data source used for the evaluation runs. Dictates the schema of the data used in the evaluation.

Source
data_source_config=(data_source_config : CreateEvalRequestDataSourceConfig)

The configuration for the data source used for the evaluation runs. Dictates the schema of the data used in the evaluation.

Source
metadata
Source
metadata=(metadata : Metadata | Nil)
Source
name

The name of the evaluation.

Source
name=(name : String | Nil)

The name of the evaluation.

Source
testing_criteria

A list of graders for all eval runs in this group. Graders can reference variables in the data source using double curly braces notation, like {{item.variable_name}}. To reference the model's output, use the sample namespace (ie, {{sample.output_text}}).

Source
testing_criteria=(testing_criteria : Array(CreateEvalRequestTestingCriteriaItem))

A list of graders for all eval runs in this group. Graders can reference variables in the data source using double curly braces notation, like {{item.variable_name}}. To reference the model's output, use the sample namespace (ie, {{sample.output_text}}).

Source