class

OpenAI::CreateEvalCustomDataSourceConfig

Inherits JSON::Serializable < Reference < Object

A CustomDataSourceConfig object that defines the schema for the data source used for the evaluation runs. This schema is used to define the shape of the data that will be:

  • Used to define your testing criteria and
  • What data is required when creating a run

Constructors

new(pull : JSON::PullParser)
Source
new(type_value : CreateEvalCustomDataSourceConfigType = CreateEvalCustomDataSourceConfigType::Custom, item_schema : Hash(String, JSON::Any) = Hash(String, JSON::Any).new, include_sample_schema : Bool | Nil = nil)
Source
new(*, __pull_for_json_serializable pull : JSON::PullParser)
Source

Instance methods

include_sample_schema

Whether the eval should expect you to populate the sample namespace (ie, by generating responses off of your data source)

Source
include_sample_schema=(include_sample_schema : Bool | Nil)

Whether the eval should expect you to populate the sample namespace (ie, by generating responses off of your data source)

Source
item_schema

The json schema for each row in the data source.

Source
item_schema=(item_schema : Hash(String, JSON::Any))

The json schema for each row in the data source.

Source
type_value

The type of data source. Always custom.

Source
type_value=(type_value : CreateEvalCustomDataSourceConfigType)

The type of data source. Always custom.

Source