OpenAI::TruncationObject
Inherits JSON::Serializable < Reference < Object
Controls for how a thread will be truncated prior to the run. Use this to control the initial context window of the run.
Constructors
Instance methods
The truncation strategy to use for the thread. The default is auto. If set to last_messages, the thread will be truncated to the n most recent messages in the thread. When set to auto, messages in the middle of the thread will be dropped to fit the context length of the model, max_prompt_tokens.
The truncation strategy to use for the thread. The default is auto. If set to last_messages, the thread will be truncated to the n most recent messages in the thread. When set to auto, messages in the middle of the thread will be dropped to fit the context length of the model, max_prompt_tokens.