class

LLM::ContextOverflow

Inherits Exception < Reference < Object

A request whose prompt is over the model's context window, raised for a caller that asked to re-split instead of getting "". limit is the window and used the prompt's real size, when the provider named them.

Constructors

new(limit : Int32 | Nil = nil, used : Int32 | Nil = nil)
Source

Instance methods

limit
Source
used
Source