class

OpenAI::RealtimeTruncationRetentionRatioTruncationTokenLimits

Inherits JSON::Serializable < Reference < Object

Optional custom token limits for this truncation strategy. If not provided, the model's default token limits will be used.

Constructors

new(pull : JSON::PullParser)
Source
new(post_instructions : Int64 | Nil = nil)
Source
new(*, __pull_for_json_serializable pull : JSON::PullParser)
Source

Instance methods

post_instructions

Maximum tokens allowed in the conversation after instructions (which including tool definitions). For example, setting this to 5,000 would mean that truncation would occur when the conversation exceeds 5,000 tokens after instructions. This cannot be higher than the model's context window size minus the maximum output tokens.

Source
post_instructions=(post_instructions : Int64 | Nil)

Maximum tokens allowed in the conversation after instructions (which including tool definitions). For example, setting this to 5,000 would mean that truncation would occur when the conversation exceeds 5,000 tokens after instructions. This cannot be higher than the model's context window size minus the maximum output tokens.

Source